Crayons. Chronicles. Captains

Meet our talented tangrams from across the Box, and find out where we’ve been making headlines
5 big challenges still facing the Internet of Things (IoT)

As the Internet of Things (IoT) continues to steer operations in the 21st century, numerous challenges are coming to light. While the IoT still has the potential to transform business for owners, employees and customers alike, those who already embrace this next-gen...

Top five best data visualization techniques for 2018
Top five best data visualization techniques for 2018

People are able to process visual information much faster than textual content. For this reason, data visualization is an essential model of contemporary business intelligence. There are hundreds of techniques to present business-related information and sometimes it...

Cognitive computing: Moving from hype to deployment

Although cognitive computing, which is many a times referred to as AI or Artificial Intelligence, is not a new concept, the hype surrounding it and the level of interest pertaining to it is definitely new. The combination of hype surrounding robot overlords, vendor...

Top 10 best practices in MySQL

MySQL is the second most widely used open-source relational database management system in the world. It has become so popular because of its consistent fast performance, high reliability and ease of use. This article presents some of the best practices in MySQL. Best...

How to run Linear regression in Python scikit-Learn

You know that linear regression is a popular technique and you might as well seen the mathematical equation of linear regression. But do you know how to implement a linear regression in Python?? If so don’t read this post because this post is all about implementing...

Digital transformation in Banking: Past, Present and Future

Regardless of how much people earn, the jobs they have or whether they’re part of the workforce, banking is a necessary routine. It may not come to mind as one of the most technologically advanced industries, but has still undergone some significant advancements that...

9 powerful Google Analytics tips for your eCommerce website

eCommerce opened the boundaries of traditional trade and enabled entrepreneurs to reach target audience anywhere in the world. It gave rise to the plethora of new businesses but also made everyone wonder – who is my average buyer and what do I know about this person?...

Top 10 trends in payments 2018 (Infographic)

The universe of banking and payments is ever evolving. 2017 has seen a number of significant changes in the payments industry, thanks to advances in technology. Consumers now have access to a myriad of ways to pay. As a result, payment and shopping habits change....

If web crawling helped Google so much, why not for you?
If web crawling helped Google so much, why not for you?

I am a big Google fan. Before I start pouring in praises for the search giant, it’s quite amusing to note that their well-loved search routine begins with the modest process of web crawling performed by crawlers (aka spiders or bots) commonly referred to as Google...

Big Data in aviation – Six trending technologies

Large and Luxurious - has become a way of life for the city of impeccable architecture and style – Dubai. Apart from being the largest among UAE cities, it houses the world’s tallest building, biggest natural flower garden, the most massive mall, world’s heaviest Gold...

Big data solutions to take a bite out of fraud!

The modern economy has seen a mass migration of retailers to e-commerce and other digital platforms. The cost and convenience advantages have produced a sales revolution for a number of varied industries but have also created new vectors for fraud and abuse. The...

Medical big data: From reluctance to revolution

The role of big data in the healthcare industry has been growing rapidly in recent years. State-of-the-art analytical tools are being applied to patient medical information in order to extract meaningful health trends and provide timely preventative care. The industry...

Interview with banking expert Vikram Atal
Interview with banking expert Vikram Atal

Tell us a little about yourself, outside of the information that is publicly available and online. Ah, that’s a tricky one. Well, it may be interesting to note that before I started my career in finance, I had explored the option of doing an advanced degree at ISI...

4 reasons why you must use big data for sales prospecting

With the continuous progress in data science, there is a huge opportunity for sales managers to achieve new insights on how to increase sales, have more satisfied customers who return again and again. But, one obstacle many organizations face is learning how to...

What skills do I need to become a data scientist?

Leveraging the use of big data, as an insight-generating engine, has driven the demand for data scientists at enterprise-level, across all industry verticals. Whether it is to refine the process of product development, help improve customer retention, or mine through...

Review of 20 best big data visualization tools

Big Data is amazing. It describes our everyday behavior, keeps track of the places we go, stores what we like to do and how much time we spend doing our favorite activities. Big Data is made of numbers, and I think we all agree when we say: Numbers are difficult to...

Can big data be used to prevent crime from happening?

If you’ve seen the movie “Minority Report” — released back in 2002 — you know the premise is both unique and far-fetched. It is, after all, a science-fiction film littered with futuristic technology and unheard-of societal norms. Drugs, for example, are consumed via...

5 best ways to boost business efficiency with big data

Business data had always existed but so far had never been tapped internal efficiency. Today companies like Amazon are using this data to improve their customer relations. There are endless big data case studies where companies have leveraged Big Data to improve...

The hidden advantages data-driven sales teams have

Data. It’s something sales teams love and hate. Although it can be used effectively to boost sales and assists you in meeting your targets and goals, it’s a time-consuming process to sift through large quantities of it, and it can even seem daunting to some teams even...

Why small businesses need big data more than ever
Why small businesses need big data more than ever

The rise of mobile technology has created a multitude of new ways for businesses to interact with customers. Another defining feature of the digital age is the development of many powerful big data analytics tools. These two components — customer data and the tools to...

Big data is the key to strategic HR decisions
Big data is the key to strategic HR decisions

Human resources play the key role in company development. However, this profession is not only about interviews and resumes anymore. In a world filled with all sorts of information, HR teams are finding new ways to improve their results and efficiency. This is...

Why all entrepreneurs need to understand blockchain
Why all entrepreneurs need to understand blockchain

Probably, you’ve heard the buzz surrounding blockchain and cryptocurrencies by now. It’s easy to see why blockchain is valuable, but understanding how it works can be a challenge. Blockchain is a complex piece of technology that’s capable of changing many facets of...

Review of top 10 online Data Science courses

As more and more of life’s day-to-day work and personal activities are being simplified by Big Data technologies, the need for data scientists has risen remarkably for the past several years. Companies around the world scamper desperately to grab people with data...

The Kindness of Strangers – Thank you Singapore

It was 20 years ago today The Kindness of Strangers Thank you Singapore (Sung to the tune of Sgt Pepper’s…..) It was 20 years ago today That I came to Singapore to play I’ve been going round and round in life Even found myself a wife So may I re-introduce to you The...

5 common myths all small businesses have about big data

It is evident that big data is a potential game changer for any business that wants to stay ahead of its competitors. For instance, companies that use big data provide better customer care services, more efficient targeted ads, and stronger business relationships than...

Three ways big data is transforming the medical field

From its role in global epidemics to new wearable technology and public health analysis, big data is having a tremendous impact on the medical field. There are many potential benefits, but also possible drawbacks: while patients will be armed with more knowledge and...

R – What’s in it for me?

Although R has been around since the 90’s it’s only become widely known in the last few years. The explosion of data being produced by websites, the Internet of Things etc has led to great interest in how to analyze and use that data to best effect which is where R...

Four cognitive biases that affect big data analysis
Four cognitive biases that affect big data analysis

Data collection methods have evolved dramatically – especially with the ability to collect big data. The removal of human error by quantitatively logging information for statistical analysis improves the validity of the data collected, which intimates that whatever...

10 useful resources for those who wants to know more about SQL

SQL, Structured Query Language, is the primary language responsible for management of data and data structures within a relational database management system. In other words, SQL is a language used to communicate with a database. It is important to mention it is one...

Why big data needs the benefits of blockchain
Why big data needs the benefits of blockchain

Big data and blockchain are two technologies that are expected to transform the way we do business the coming years. They’re powerful on their own but even more so when combined. Here’s why big data needs the benefits that blockchain provides. What Is Blockchain? The...

Four things you need to know about Cluster Programming

In the world of Big Data, information has evolved from being a merely passive construct into an active and dynamic abstraction. The language of this information is the computer code, but before diving into cluster programming, there are several things that you must...

The new number game – Making sports smarter with big data
The new number game – Making sports smarter with big data

When we think about analytical data, we imagine information collated and used in advanced niches such as the medical and computer industries. But there’s one other industry that uses analytical data on a major scale and has done so since the dawn of time. We are of...

Top 5 ways big data can make our world greener

It’s true that technology has contributed a lot to the environmental crisis we’re currently facing. Old electronics dumped into landfills, plastics, air pollution—the list goes on. While it’s easy to blame everything on technology, it’s important to remember that it’s...

What are Hadoop alternatives and should you look for one?
What are Hadoop alternatives and should you look for one?

Hadoop’s development from a batch-oriented, large-scale analytics tool to an entire ecosystem comprised of various application, tools, services, and vendors goes hand in hand with the rise of big data marketplace. It is predominantly used for large scale data analysis...

Data analytics can take you places that you can’t imagine

Analytics has been a well-known strategy to identify opportunities, streamline work, and take decisions. Almost all businesses in some form or other make use of analytics. The scheduled annual appraisals in a company is a simple example of analytics usage. While usage...

Top 10 high paying countries for data scientist

Data—we are surrounded by it. We create 2.5 quintillion bytes of data every single day. More and more industries have begun to leverage data for business growth. And this has given rise to the big data revolution. The demand for data scientists has seen a steady rise...

Three benefits of tracking employee data for your business

Employee data tracking—sounds like a lot of extra work, right? How do you keep tabs on employee data for more productivity, better bookkeeping, and safer employees? Your employees generate a lot of data and using data tools for your business just makes sense. There...

Top 5 industries leading the way in IoT integration

With connected smart devices expecting to number in the billions over the next few years, the Internet of Things is becoming a major factor in consumer expectations and business planning. The IoT is impacting our lives more than you may realize. The following list was...

The business of transferring data from Salesforce to Hadoop

The sustained success of Hadoop has brought about a radical change in big data management. This highly popular open-source MapReduce technology allows easy access and provides reliable answers to advanced data questions. Data management has been taken to the next...

Get chatty: Banks and their customers have a common friend

Chatbots are taking over the world. Banks have started investing in this intelligent chatty friend, to make their customer conversations easier and more efficient. Human – human to human- machine? .... Better? Safer? Faster? What are chatbots? Chatbots are programs...

Diving into an ocean of mobile data: Can you do it?

Mobile devices have quickly reached the top of the list as the most popular platform to browse the web on. Mobile phones are cheaper than purchasing a desktop (especially in developing countries who weren’t a part of the desktop dominated phase) and mobile devices are...

Excel tips and tricks for efficient data analysis

It’s an obvious, well-known fact that data and business go hand in hand. You can’t manage one without affecting the other. And whether you’re analyzing a client’s data or using your company’s data to make executive decisions, your tools have to be able to handle the...

Five tips to make managing a supply chain easier
Five tips to make managing a supply chain easier

There are a few things that matter quite as much in the business world as efficiency. Whether it be in relation to employee productivity, vendor relationships or otherwise, an efficient business is a successful business. This couldn’t be truer when it comes to supply...

Debunking five digital marketing myths around Big Data

Have you ever noticed that some companies make the wrong decisions when it comes to digital marketing strategies? Even in this age of digitalization? Surprisingly, it isn’t because of their lack of resources, opportunities or manpower. But, they fail. The result?...

This is how a typical day of a data scientist looks like

Data drives companies’ success. It is very important to manage data because it runs systems, businesses, academies and dialogue. We can predict natural disasters, improve social media reach, dethrone anarchists and sell more stuff using data. But how exactly do we use...

March 14 – 3.14159 ways to celebrate Pi Day
March 14 – 3.14159 ways to celebrate Pi Day

Pi (π) might be an irrational number, but you don’t have to be crazy to celebrate it. You finally have permission to commemorate your favorite number, as March 14th is international Pi Day. On 3/14, which sort of looks like 3.14 or the first three digits of pi,...

Why use Hadoop? Top pros and cons of Hadoop
Why use Hadoop? Top pros and cons of Hadoop

Big Data is one of the major areas of focus in today’s digital world. There are tons of data generated and collected from the various processes carried out by the company. This data could contain patterns and methods as to how the company can improve its processes....

How is predictive data shaping the auto industry

Predictive data is quickly changing the way that we work in a variety of industries, and the automotive world is no exception. From connected car production to inventory management, the collection and study of large amounts of data are quickly shaping how our cars are...

No silver bullet in innovation
No silver bullet in innovation

Managers have this bad habit of looking for a silver bullet. That magical holy grail that will make all of their problems go away quickly, and preferably painlessly. Those expensive consultants. That fancy new CRM system. This flashy acquisition. That confusing and...

The power of one sigma

Six Sigma is a quality improvement program that gets its name from the concept of 99.9997% quality. In statistics, each sigma represents the statistical measure of 1 standard deviation from the mean in a range of outcomes in a normal distribution. Six Sigma translates...

5 data analytics trends that will change businesses in 2017

The amount of data being collected and stored globally is inconceivable and it grows as we speak. The end result is “big data.” As the term implies, big data is used to denote large sets of structured or unstructured data.  However, the large volume isn’t what makes...

Fintech – Beyond innovation theatre
Fintech – Beyond innovation theatre

Beyond Innovation Theatre Innovation is all about value creation. Or at least it should be. It’s easy to get caught up in the front end of the process. Brainstorming new ideas, drawing on whiteboards, and moving different colored sticky notes around the wall is fun....

Do you know what is powerful real-time analytics?

In the Digital age today, world has become smaller and faster. Global audio & video calls which were available only in corporate offices, are now available to common man on the smartphone. Consumers have more information of the products and comparison than the...

What are Microservices in Digital Transformation?

Today’s organizations are feeling the fear of becoming dinosaur every day. New disrupters are coming into your industry and turning everything upside down. Customers are more demanding than ever and will abandon the service that is too slow to respond.  Everything is...

This is how analytics is changing the game of sports

Analytics and Big Data have disrupted many industries, and now they are on the edge of scoring major points in sports. Over the past few years, the world of sports has experienced an explosion in the use of analytics Till a few years back experience, gut feelings, and...

Top 5 best TED talks on data analytics for business leaders

What are you doing right now? If you are trying to know how data analytics can help you grow your business, you are not alone. Research suggest that as much as 55% of companies are rapidly searching for and engaging in some form of data analytics to get a hold of what...

Why big data is crucial for your IRL marketing

Gathering and analyzing data is important for everything you do. It’s game changing. It is especially important when you're trying to branch out. Plotting out your marketing, determining who is listening, and how you can reach them is vital for any sort of effective...

Life @Crayon – Mridula

  How long have you been at Crayon? A little over two years. What do you do at Crayon? All things marketing with a sprinkle of PR. What’s your average day like? A day where the unplanned usually topples the planned. What’s your favorite Crayon memory? They are...

8 big data trends and predictions for 2017

The term Big Data is more than 20 years old, having been coined in 2005 by O’Reilly Media’s Roger Magoulas. What we mean by the term scales larger by the minute, seemingly, since more than 80% of all available data has been generated in the last three years as Big...

Big bata, banks and mobile payments: What is next?
Big bata, banks and mobile payments: What is next?

Just about every industry has something to say about big data. It’s changing the way bookies make predictions; helping sports coaches make better decisions, and furnishing healthcare companies with the tools to improve patient care. The phenomenon has already produced...

Say goodbye to boring, automated tele-conversations
Say goodbye to boring, automated tele-conversations

Panic! One can’t truly appreciate the sense of this word until you realize you have misplaced your wallet that has your credit cards! So, you frantically call home or office just to check whether you have left your wallet over there. And you finally realize that you...

Fail fast approach to digital transformation

Digital Transformation is changing the way customers think & demand new products or services. Today Bank accounts are opened online, Insurance claims are filed online, patient’s health is monitored online while buying things online is the thing of past. Everything...

Say goodbye to boring, automated tele-conversations

Panic! One can’t truly appreciate the sense of this word, until you realize you have misplaced your wallet that has your credit cards! So, you frantically call home or office just to check whether you have left your wallet over there. And you finally realize that you...

Top 6 tools to master and get started with Big Data

The market is flooded with a number of Big Data tools. All of them claim to provide real business value by bringing cost efficiency, better time management, and analyzing data to discover valuable business insights. But there are only a select few that actually do...

How to discover hidden value in your customer journey

The world of business and customer service has changed immensely over the past few years. Whereas once business was largely driven by outbound marketing and advertising, in today’s world you have to consider the customer experience and your customers’ journey as they...

Why blockchain? What can it do for big data?
Why blockchain? What can it do for big data?

Arguably the most significant development in information technology over the past few years, blockchain has the potential to change the way that the world approaches big data, with enhanced security and data quality just two of the benefits afforded to businesses...

How much of a benefit is big data to sports fans?
How much of a benefit is big data to sports fans?

American sports fans, in particular, love big data, and analyzing every quantifiable aspect of a team’s performance is as much a part of the game as turning up to the field on game night. Taking Sunday’s NBA game between the Golden State Warriors and the Minnesota...

DNA vs modern backup methods: The future of data storage

It’s difficult to wrap one’s mind around this, but it’s now possible to store vast amounts of data on a DNA strand. Isn’t it ironic that so much of the world’s data is stored via computerized data centers that are the result of many years of information technology and...

Top big data misconceptions debunked

The idea and concept of “Big Data” has been around for a while now, however it seems there are many people who still believe it is shrouded in mystery. Therefore, in the following post we are going to debunk some of the top big data misconceptions. Every business has...

Bridging RDBMS and NoSQL: Introduction to 2DX UI cluster

2DX is a Web UI framework that consists of in-memory Browser NoSQL and RDBMS hosting Stored Procedure-built JavaScript interpreter. Both NoSQL and RDBMS database components of 2DX follow same Entity-Attribute-Value database schema designed to accommodate serialized...

Refining your ecommerce business with big data

For the last few years, it seems like the concept of Big Data is inescapable. Wherever you look – whether it’s Forbes, Tech Republic or even Fortune – everyone has to say something about Big Data. But when you take a closer look and realize the potential of Big Data,...

Banking on blockchain: The future is already here?
Banking on blockchain: The future is already here?

On the first week of November, I attended an IBM blockchain discussion at Rise New York, featuring Jalak Jobanputra, Founder and Managing Partner of Future\Perfect Ventures and Brigid McDermott, Vice President of Blockchain Business Development & Ecosystem for...

Building better Bank-Fintech partnerships
Building better Bank-Fintech partnerships

Talk of banks and fintech companies partnering together has increased dramatically in the past year.  There have definitely been some interesting partnerships announced, particularly with some of the marketplace lenders, various blockchain projects and some artificial...

Using data science for predictive maintenance

Remember a few years ago there were two recall announcements from the National Highway Traffic Safety Administration for GM & Tesla – both related to problems that could cause fires. These caused tons of money to resolve. Aerospace, Rail industry, Equipment...

What is edge computing?

The name edge computing signifies the corner or edge in a network diagram at which traffic enters or exits the network. Edge computing pushes computing power to the edges of a network, so instead of devices like drones or smart traffic lights needing to call home for...

Mobile enablement in digital age

Gone are the days when we used to carry big fat wallet filled with cash, coins, multiple credit cards, business cards, travel tickets, movie tickets, personal notes, papers with names, numbers and the list can go on. Mobile technologies have transformed the way we...

Life @ Crayon – Kandarp

How long have you been at Crayon? 3 Years and 6 Months What do you do at Crayon? Project Lead (Delivery) and Business Analyst What’s your average day like? I arrive at work with a plan of what I need to do for the day. This plan involves spending 50% of my time in...

Applications of Predictive Analytics in various industries

They say that those who do not study history are doomed to repeat it. In no form of big data analysis is this phrase more relevant than in 'predictive analytics'. In simple terms, predictive analytics is the systematic use of data, machine learning techniques and a...

The IOT Continuum – How do you see it?

Over the past months, I have read a great deal about the Internet of Things (IoT) and how companies are moving forward with it. Looking across all the stories on the web it is clear that there is an IoT Continuum when you look at the different types of projects out...

Designing a better banking experience
Designing a better banking experience

Last week at Money20/20 in Las Vegas I spent some time behind the scenes at Capital One to see how they are using technology, innovation, and design to create a better banking experience. I sat down with Scott Zimmer, Capital One’s Global Head of Design, to focus on...

Crayo-thon: Crayon's first Hackathon

We ran our first hackathon at Crayon. Teams from our Chennai and Singapore offices participated. And boy, did we receive some impressive prototypes. One of the great things about the Crayo-thon was that it brought people from very different teams together. All working...

VPN use and data privacy stats for 2016
VPN use and data privacy stats for 2016

We presented a host of survey findings regarding vital internet trends in a previous article. We hope you found it useful! Yet at our core, we want our readers up-to-date on the latest information regarding vpn use and data security. So, this article assimilates many...

Six challenges of big data project management

Project management always comes with a set of various challenges. In the past couple of years, as businesses have significantly grown, project management has become even more complicated. On the other side of things, a variety of software solutions were created for...

Life @ Crayon – Bhavani

How long have you been at Crayon? Eight months. 2. What do you do at Crayon? I am the CFO (Chief Financial Officer) of Crayon. 3. What’s your average day like? I mostly push people to do their work. I think I should rename my job description to Chief Pushing Officer....

How to fetch HBase table data in Apache Phoenix?
How to fetch HBase table data in Apache Phoenix?

This exclusive post is shared by big data services providers to help developers in development. They tell the best way to fetch HBase table data in Apache Phoenix. Read this article and discover what they have to say about Big Data related services. The term 'Big...

What Pokémon has got to do with big data?

Last weekend I went to the park to take my baby daughter for a walk, but I knew that it would be a walk with an extra level of intrigue above the usual cooing, dribbling, and occasionally uncontrollable bawling. No, on the previous day I downloaded PokémonGo onto my...

Will big data open a Pandora’s Box of injustice?

Databases. They are not just confined to big business. Remember that rogue traffic warden, who gave you a parking ticket thirty seconds before your time was up? Remember that customer service agent, who was rude and unhelpful to you over the phone? Remember that...

Cohort analysis: Retention Rate Visualization with R

When conducting Cohort Analysis, one of the most important measures is Customer Retention Rate. I will share a few ideas for visualizing this parameter in this post. Last year I shared several charts for Customer Retention Rate visualization in this post. However, it...

Treat your data like an asset – Not an inconvenience

How do you look after your valuables? Do you use a safe deposit box or a postcode marker pen? You probably have the software installed on your smartphone to track it if it gets stolen, and no office is truly secure without CCTV. Taking care of business assets is key...

IITs revoke ban on big data company Crayon Data

NEW DELHI: All IITs (Indian Institutes of Technology) Placement Committee (AIPC) has revoked the ban on big data company Crayon Data with offices in Singapore and India. Crayon Data was among the 31 companies that recently barred by the AIPC as they failed to honour...

The future of “The Internet of Olympic Games”

Forgive me for using this headline to attract more readers during the summer holidays. Certainly, I will include a comment in my famous post The abuse of shocking headlines in IoT or how many stupid things will be connected ?. I encourage you to continue reading. The...

Digital Transformation – Top 5 challenges to overcome

The Digital Tsunami is moving at a rapid pace, encompassing all aspects of business and society. It touches every function of business from purchasing, finance, human resources, operations, IT and technology, sales and marketing and every other division in the...

What exactly is cognitive computing?

Although computers are better for data processing and making calculations, they were not able to accomplish some of the most basic human tasks, like recognizing Apple or Orange from a basket of fruits, till now. Computers can capture, move, and store the data, but...

Is data quality essential for modern business?

If you wanted to program a computer in the early 1980s, you didn’t have the option of coding using a keyboard. You had to create a series of cards, each punched with a pattern of holes. The holes had to be entirely accurate, in both pattern and placement. A typical...

Life @ Crayon – Varun

  1. How long have you been at Crayon? 3 years 2. What do you do at Crayon? I build big data applications using Java and Python. 3. What’s your average day like?  The day mostly involves email, coding, chatting and working with incredibly smart co-workers, lunch...

Banks risk losing $600 billion of millennial spending

The banking industry needs to reimagine what current day banking means to millennials, or risk losing out on a potential $600 billion of indirect spending that millennials can influence. By the year 2020, Asia will be home to 60 percent of the world’s millennials, who...

Does big data have a dark side?
Does big data have a dark side?

Big Data is seen as a savior for small companies, massive corporations, and governments. However, drawing from massive datasets to obtain a better understanding of human behavior does have a potential dark side. Technology is only as good as the people using it....

Banks are from Mars…

It is not news here, or anywhere else, but bankers and fintech entrepreneurs are from different planets. They are just wired differently. Just a few years ago, all of the fintech companies wanted to put traditional financial institutions out of business. Disrupt the...

Top 10 tools market researchers should explore

Nowadays there is a great variety of different useful tools for market researchers that are free and open for usage. Today you can use such instruments to enhance your business and significantly improve the effectiveness of your work. Leaving you a chance to waste...

Life @ Crayon – Grace Lee

Life at Crayon by Grace 1) How long have you been at Crayon? 3 years and 8 months 2) What do you do at Crayon? I’m the Ops manager, I handle Finance, HR, Admin work, P.A, or any other ad hoc work. 3) What’s your average day like? Busy, dealing with all the urgent work...

How to become a data driven business

Data is everywhere. All businesses have access to it. Yet, turning data into actionable insights and becoming a data-driven business can be difficult to achieve. What does data-driven mean? A data-driven business utilizes data to inform every business decision they...

SAP HANA for real-time analytics [Research paper]

There is no doubt that data analytics is the most favored method for extracting viable and venerable insights out of data volumes. There are a continuous accumulation and storage of poly-structured data due to the unprecedented increase in different and distributed...

Rick Smolan on 'The Human Face of Big Data'

  Manu: Rick, can you tell us a bit about yourself?  I saw in your TED talk that you used to be a photojournalist, so how did you get started on this journey? Rick Smolan: Yes, I was always very curious as a person. So it is interesting that I'd end up in a job...

A poem on Crayon's Data Factory

For years, big data has been one of the hottest buzzwords across all industries. Big data is the term used to describe the process of analyzing complex data sets to discover information that can help make better decisions or find certain patterns that were previously...

How your small business can use big data successfully

The great thing about small businesses is their intimate appeal and unique nature. Without the little guys, the business world and the products and services it delivers would be homogenized and dull. But enterprises are constantly looking at ways to dominate the...

Life @ Crayon – Shobana

  1) How long have you been at Crayon? Ten months. 2) What do you do at Crayon? Manage product testing. 3) What’s your average day like? First, I look at my team’s deliverables. Then these are discussed with the team to ensure that we are on the same page. The...

Top 10 reasons why you should learn data analytics

They say we are living in the age of information. The internet has made it easy for anyone to gather whatever information they need to achieve whatever end they desire. Did you know that you could even learn how to build your own car online? Did you know that you...

Do you need a Chief Data Scientist?

If you are considering recruiting a C-level executive in charge of data science, you are not alone. More and more analytics-driven companies are finding office space for this critical role. Even the Commander-in-Chief is jumping on the chief-of-data-science bandwagon....

The Fintech grief cycle for bankers

As a few fintech companies like Lending Club, Betterment, and others have run into some rough patches lately, it has been interesting to note some of the reactions, especially amongst bankers (that’s just shorthand, I’m looking at you too, credit union leaders). Some...

Constraining Data flexibility in a NoSQL database

Having no constraints in a NoSQL database means complete data flexibility. This sounds appealing at first given the fact that it saves development time by not defining any columns or data types at the time of inception of your collections. But this much flexibility...

How to use DMS to manage your business data

Data management is one of the most important tasks for any modern business. Businesses need to analyze and inspect the data to find out the consumer demands and the best ways to meet these. Managing the huge amount of data requires a specialized solution. And Document...

How to build better data products: Getting started

This is the first in a multi-part series on launching successful data products. At Juice, we’ve helped our clients launch dozens of data products that generate new revenue streams, differentiate their solutions in the market and build stronger customer relationships....

Can business automation solve your data quality problems?

All businesses are at the mercy of data quality challenges. From the moment you capture your first lead, you’ll be fighting a battle against data decay. The bigger the database gets, the more problems the business can encounter, and it isn’t easy to single out a...

How will deep learning change your business?

The media interest surrounding deep learning has grown exponentially in the last few years. But what does it actually mean, and how will it change business and society? Deep learning is a subset of machine learning that refers to mapping artificial neural networks to...

The future of OTA loyalty programs

Online Travel Agents (OTAs) are known as an effective distribution channel for hotel rooms, but with more major hotel brands pushing direct bookings in an effort to reduce commissions paid out to agents– this leaves OTAs searching for the next goldmine product to fuel...

How big data is changing the way you fly

A journey into predictive analytics and how data will drive up airline ticket prices. As airlines and frequent flyer programs gather more intelligence on your day to day lifestyle, flying and financial position - they begin to build a data profile on your interests,...

Strategic planning: Stacking the odds in your favour
Strategic planning: Stacking the odds in your favour

It’s midyear already. Halftime. Two quarters down and two to go for 2016. For many financial institutions, it’s also the start of the 2017 strategic planning season. That time when boards and senior leadership teams sit down to hash out next year’s budget; working...

Will machines help us to be better people?

Cisco defines the Internet of Everything (IoE) as bringing together people, process, data, and things to make networked connections more relevant and valuable than ever before-turning information into actions that create new capabilities, richer experiences, and...

Choice and the new consumer: Article 2 in a series of 5

In my last post, we talked about the growing importance of two concepts that are radically changing consumer marketing practices: The Choice Equation and the Influence Mix. The influence mix { D = f(P+M+O)}, captures the forces behind a consumer purchase decision by...

10 useful ways to visualize your data (with examples)
10 useful ways to visualize your data (with examples)

Many people spend their day sifting through data, combining multiple data sources, and finally getting data ready for the moment of truth: seeing it in a data visualization. Data visualizations are the culmination of all data crunching work–they’re supposed to take...

Is UBI the next big thing in insurance
Is UBI the next big thing in insurance

UBI, or user based insurance, may become the new basis for personalized premium prices, as the IoT continues to grow and connect increasingly advanced technology. According to SMA Research, 36% of auto insurers will use telematics UBI by 2020. Acenture’s 2015...

The data quality tipping point

Whatever your business sector, data is your most valuable asset. Along with the machinery and stock you hold, data and insights hold the key to profit and growth. But it has the unique ability to unite every department, and every function. It can reveal problems in...

Why business intelligence is no longer a luxury

Once thought of as something that was only available to Fortune-500 companies, there are fewer and fewer reasons for companies to not have a strategy for their business insights. Not only has mobile device security improved greatly in the last five years, there are a...

Life @ Crayon – Itzhik

  How long have you been at Crayon? Since July 27th, 2015. 475 days have passed like it was a single moment. What do you do at Crayon? I lead the product management, engineering and customer deployments teams. AKA Product. What’s your average day like? No one day...

Mobile first strategy for digital transformation!!

Today we live in “always on, always connected” world, and use mobile for almost everything. On our smartphone we get answers to so many questions like “I am hungry, where can I quickly grab a bite”, “it’s time to buy a new car, which model & dealer I should go for”,...

How Block Chain is disrupting many industries
How Block Chain is disrupting many industries

Until recently, Blockchain was a term only known to geeks and specialists. But in the last six months, it has become a buzzword. In very simple terms Blockchain is the act of recording events in a database. The database itself is referred to as the Blockchain. Once...

Top 11 key tuning checklists for Apache Hadoop
Top 11 key tuning checklists for Apache Hadoop

Apache Hadoop is a well know and de-facto framework for processing large big data sets through distributed & parallel computing. YARN(Yet Another Resources Negotiator) allowed Hadoop to evolve from a simple MapReduce engine to a big data ecosystem that can run...

9 inspiring quotes from experts shaping the future of banking

Who doesn’t like a good quote? We come across interesting and useful quotes all of the time in literature, news media, entertainment, and so on. A potent, succinct quote that underlines a key point or supports an important truth can be like gold. Often the value of a...

Crayon Data selected to join Amadeus Next

Singapore based creators of the next generation of Choice Engines, poised to shape the future of travel Singapore/Chennai – 4 May, 2016 – Crayon Data, one of Asia’s fastest growing big data companies has been selected to be part of Amadeus’ Asia Pacific travel...

The role of big data in the banking industry
The role of big data in the banking industry

The banking industry has evolved by leaps and bounds over the past decade, when it comes to operations and service delivery. Surprisingly though, most banks have failed to utilize the information within their own databases. However, that’s all about to change as the...

Eight breakthrough changes in Apache Flink 1.0.0
Eight breakthrough changes in Apache Flink 1.0.0

Apache Flink is an open source platform for distributed stream and batch data processing. Flink’s core is a streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams. Flink also builds...

How data bonds sales and marketing together

So far in 2016, we’ve heard a lot about Big Data, the Internet of Things, and the hottest new marketing technique on the block: ‘hyper-personalised’ marketing. Marketers are increasingly interested in focusing their efforts on individuals, not database segments...

10 new exciting features of Apache Hive 2.0.0
10 new exciting features of Apache Hive 2.0.0

We should be excited that Apache Hive community have released the largest release and announced the availability of Apache Hive 2.0.0. It brings great and exciting improvements in the category of new functionality, Performance, Optimizations, Security, and Usability....

Life @ Crayon – Amrit

  1) How long have you been at Crayon? Just about 4 years now. 2) What do you do at Crayon? Ah, the eternal mystery :). If anyone  this knows, be sure to let me know! Besides making a general nuisance of myself, I assist our Product Engineering team. 3) What’s...

9 must watch big data technologies along with Hadoop!
9 must watch big data technologies along with Hadoop!

Today emerging big data technology firm focused on helping enterprises build breakthrough software solutions powered by disruptive enterprise software trends like Machine learning and data science, Cyber-security, Enterprise IOT, and Cloud. So Hadoop is one of the...

Why AI and Machine Learning are not the same thing

With the evolution of digital technology, the definitions of AI and Machine Learning are quite distinct from what they were before. Add to that the complexity of people using these terms interchangeably or to mean different things, and we have a prime example of our...

What is SMACK (Spark, Mesos, Akka, and Kafka)?
What is SMACK (Spark, Mesos, Akka, and Kafka)?

This blog introduces the convergence of complementary technologies – Spark, Mesos, Akka, Cassandra and Kafka (SMACK) stack. And we will see how Apache Kafka can help us to get data under control and what is it role in our data pipeline, how Spark & Akka help us to...

How is 2016 shaping up for data science – Trends

If 2015 was the ‘year of data science’ then 2016 is when it’s going to take over completely. In the past year, we saw many applications of data science in our everyday lives- from Uber, to Amazon, to Siri, to image recognition, to generally smarter marketing...

The three pillars of insurance analytics
The three pillars of insurance analytics

The insurance industry is all about assessing risk and managing the same successfully. Life insurance industry operates intrinsically by balancing risk assessment and risk management. Compiled with a large volume of data the insurance industry operates with, arriving...

The difference between UI and UX
The difference between UI and UX

I have been a web developer for over 6 years, and during my work life, I have worked both on front end and back end web development. In the past 6 years, I have seen innumerable people interchange UI(User Interface) and UX(User Experience), some even mid-sentence,...

The difference between UI and UX

I have been a web developer for over 6 years, and during my work life, I have worked both on front end and back end web development. In the past 6 years, I have seen innumerable people interchange UI(User Interface) and UX(User Experience), some even mid-sentence,...

How to write data analysis reports. Lesson 5

Perhaps the hardest part of writing a data analysis report is just getting it completed. It takes discipline and persistence to stay on track. Even so, it’s easy to get distracted. Sometimes the problem is that the story of the analysis hasn’t been thought all the way...

Demystifying data scientists [Infographic]

Data Scientists are the mystical creatures today. There is some debate around who can be qualified as a Data Scientist and who would be an analyst. In this infographic, we demystify Data Scientists! This infographic originally appeared here. Republished with...

Can Fintechs take banks to the edge of innovation?
Can Fintechs take banks to the edge of innovation?

This post was written by a guest author Banks. When was the last time you associated the words “innovation”, “forward thinking”, “futuristic” etc. with them? I would say “never!” Banks are generally thought as being traditional and conservative. But the future isn’t...

Why data science and big data need to become best buddies

The past few years have witnessed the rise of Big Data to almost epic proportions. Along with Big Data, we also saw the rise of Data Science and saw the Data Scientist’s job become one of the most coveted profiles in 2015. Businesses continue to invest in Big Data and...

Why banks should hop on board the big data bus

Co-authored by Manu Jeevan. More than 70% of banking executives worldwide say that customer centricity is important to them Surprisingly, research by Capgemini indicates that only 37% of customers believe that banks understand their needs and preferences adequately....

Trends in healthcare Informatics: 2016 & beyond

The healthcare field has greatly benefited from advances in data analytics and informatics over the last few years.  In general, patients will continue to be more connected to their doctors and support networks via wearable technology, and they will also have...

How big data analytics can save your brand

Big data has always existed, but it’s real value for brands become apparent in the digital age due to the increased computational capability for processing data. Although a lot of suggestions have been made and frameworks developed to show brands how they can achieve...

Net promoter score pitfalls to avoid

Net Promoter Score or NPS can be a tricky process to get right. There are many parameters that impact the execution and efficiency of the process. Even after the survey is concluded, it is paramount to close loop with the customer.  In this infographic we highlight a...

6 amazing big data analysis tricks to get more customers
6 amazing big data analysis tricks to get more customers

Do you hold all the aces for running your business on successful trek? Enlisting to the names of blue chip companies requires breaking your back. If you miss it, your business will have to go back to the wall. But accurate analysis can cross the bridge of losses when...

How content marketing can empower sales teams

Although content has been an important and growing part of any marketing strategy for years, it is often overlooked, especially when it comes to sales. Sales and marketing alignment is key for a company’s growth, yet it remains to be one of the most common challenges....

Positive effects of big data in financial sector
Positive effects of big data in financial sector

The past number of decades have seen more and more of our world move into computers. Rare is the doctor’s office with file cabinets full of alphabetized patient folders or a company researcher hanging out at the library to get data for a client report. Today, our...

10 data science and big data experts to follow on Twitter

Twitter is a great source of information, and lets you quickly scan your feed and engage with content that intrigues you. Even though this eliminates a lot of unnecessary noise, you need to follow the right people, if you are on a constant lookout for great...

Personalization: Just do it. But don't overdo it

We, as customers have always wanted personalized services, whether we are buying something from a store or checking into a hotel for a stay. Services that satisfy our unique taste would make our life easier and save a lot of time. Apparently, companies have begun to...

How big data will impact sales [Infographic]
How big data will impact sales [Infographic]

Big Data has become a buzzword for businesses of all sizes. One big aspect of it is its tremendous potential to boost sales. Big Data is now believed to play an imperative role in generating prospective leads that chief managers could convert into sales by devising...

Our data platform with Docker

This article has been co-authored by Rafi Syed and Sree Pratheep. As a continuation of our earlier article on Docker, here is a brief about how we started our journey in Docker. Our goal was to have a completely self-sufficient development cum integration environment...

Our data platform with Docker
Our data platform with Docker

This article has been co-authored by Rafi Syed and Sree Pratheep. As a continuation of our earlier article on Docker, here is a brief about how we started our journey in Docker. Our goal was to have a completely self-sufficient development cum integration environment...

4 reasons startups must unlock the potential of big data
4 reasons startups must unlock the potential of big data

With Internet of Things permeating across the world, terms such as ‘Big data, data crunching and data curation’ are looming up as the latest buzz in the tech space. Data is mounting up in abundance from everywhere, measuring in trillions of amount. Proper analysis of...

Unbundling design for innovation in big data

Visual design in big data systems has undergone a significant transformation in recent years. It is mainly driven by the emergence of tactile interfaces in UI and the trends in information systems design architecture. The rise of mobile-first designs helped fuse these...

Unbundling design for innovation in Big Data

“At Crayon, the visual design always took precedence over the systems design. This is because the experience-centric systems place a premium on user experience over the backend systems efficiency. During the early decades of my professional career, I have been trained...

5 ways to simply kill your innovation initiative

I often write and speak about the “Business Prevention Department” that lurks inside banks. Devoted to sniffing out and stamping out anything that looks “risky”, the Business Prevention Department is staffed with members committed to “protecting” their banks from...

The art of Net Promoter Score – Infographic

Net Promoter Score (NPS) is a reliable metric used by many organizations to get a pulse on their customer satisfaction. However, like any process, it is critical to bear in mind certain best practices to follow. NPS was introduced in 2003 and since then has become a...

How a Chief Data Officer can make your data great

Fresh data is usually pristine. It’s data in it’s clearest, most accurate form – straight from the customer or client. If you’ve put measures in place to cut back on data input errors, such as form validation, you can be reasonably sure that the newest records in your...

Do CEOs get the big data truth or they just do not?

For so long, the foundation of the CEO’s empire has been experiencing. They have risen to the top, learned as they went along, and they lean on those who have learned alongside them. They have had enough information at their disposal to make what they saw as informed...

Top ten pointers in the new Apache Spark release (version 1.6)
Top ten pointers in the new Apache Spark release (version 1.6)

In 2016, we should be excited that Apache Spark community launched Apache Spark 1.6. Committers – There are around 1000 contributors to Apache Spark, which has doubled. Patches – Apache Spark 1.6 version includes & covers 1000 patches. Run SQL query on files –...

5 new year resolutions for innovators in banking
5 new year resolutions for innovators in banking

Here are some New Year resolutions for the growing group of bankers who are adding “innovation” to their do-to list in 2016. Getting these right will greatly improve your chances for success in the new year. 1. Define your innovation goals So, what do you want to get...

Is wearable tech creating a data time bomb?

The company that made your smartphone is no longer a hardware manufacturer. It has become adept at harvesting and managing data from its users, too. Every device has a series of sensors, as well as user login and an account where data is stored. For manufacturers of...

What is the role of RDDs in Apache Spark? – Part 1
What is the role of RDDs in Apache Spark? – Part 1

This blog introduces Spark’s core abstraction for working with data, the RDD (Resilient Distributed Dataset). An RDD is simply a distributed collection of elements or objects (Java, Scala, Python, and user defined functions) across the Spark cluster. In Spark, all...

5 ways to drive customers through your marketing funnel

The power of market funneling allows you to do more with your pre-existing traffic. Not sure what I’m talking about? Essentially, a marketing funnel is the path you’d like your visitors to take through your site, ultimately resulting in a conversion of some sort. No...

Is Apache Hadoop the only option to implement big data?
Is Apache Hadoop the only option to implement big data?

Yes, Hadoop is not only the options to big data problem. Hadoop is one of the solutions. The HPCC (High-Performance Computing Cluster) Systems technology is an open source data-driven and intensive processing and delivery platform developed by LexisNexis Risk...

Ten handy Python libraries for (aspiring) data scientists

Data science has gathered a lot of steam in the past few years, and most companies now acknowledge the integral role data plays in driving business decisions. Python, along with R, is one of the most handy tools in a data scientist’s arsenal. It’s also one of the...

Bridging the customer experience gap
Bridging the customer experience gap

The prevailing view of most financial industry leaders over the past decade has been that internal innovation was optional at best, and probably harmful to the way they’ve been used to doing things for so long. Meanwhile, innovation bloomed on the edges and outside of...

Does your business need a big data initiative?

“It is a very sad thing that nowadays there is so little useless information.” Oscar Wilde As far as we know Wilde did not live in a Big Data age but his quote is strangely prescient. It would seem that today almost everything we do generates data that is captured,...

Building an "Information-Centric" enterprise

As consumers, each of us is fully cognizant of and deeply entwined with the "Information" economy. Whether we use Google to search, shop on Amazon, connect with friends on Facebook or hail a cab using Uber, we hardly give a moment’s thought to the "building blocks"...

“Big Data Tsunami”- are our jobs at stake?

I understand the title is super dramatic but there is a hidden fact in this article. So Keep reading… Being a big data enthusiast, I always adhere to its roots of bringing goodness to the technology but you should also think where this is taking us. Every day we...

Five things banks can learn from startups

Most bankers don’t spend a lot of time with start-up companies. The need for bankers’ loan decisions to be right 99% of the time tends to not mix well with most start-ups’ risky and voracious appetite for capital. Outside of a few bankers in Seattle, Silicon Valley,...

Crayon Data enters Indian shores, allies with GroupM

Singapore based big data start-up, Crayon Data is setting up India operations in association with WPP's media agency conglomerate GroupM. Mindshare, one of the GroupM agencies, is all set to bring its global alliance with Crayon Data to the Indian market. Mindshare...

Framework of an Apache Spark Job Run!
Framework of an Apache Spark Job Run!

Now our the big data analytics community has started to use Apache Spark in full-swing for big data processing. The processing could for ad-hoc queries, prebuilt queries, graph processing, machine learning, and even for the data streaming. Hence the understanding of...

Data is the new oil of the Digital Economy

Everyone from geeks to CEOs is on the data bandwagon. Today, for a CEO to say, “I’m not investing in data and analytics” is the same as him saying “I’m not interested in our customers”. The real question is not whether you invest in data or not. What matters is what I...

The top 12 Apache Hadoop challenges
The top 12 Apache Hadoop challenges

Hadoop is a large-scale distributed batch processing infrastructure. While it can be used on a single machine, its true power lies in its ability to scale to hundreds or thousands of computers, each with several processor cores. Hadoop is also designed to efficiently...

Get ignited by Apache Spark – Part 2
Get ignited by Apache Spark – Part 2

Thanks for your time; I definitely try to value yours. In part 1 – we discussed about Apache Spark libraries, Spark Components like Driver, DAG Scheduler, Task Scheduler, and Worker. Now in Part 2 -we will be discussing on Basics of Spark Concepts like Resilient...

Tools in the data armoury: R vs Spark

The purpose of this article is twofold. The first is to give a quick comparison between R and Spark, in terms of performance. The second is to introduce you to Spark's ML library. Background As R is inherently single threaded, it may not be wise to compare Spark and R...

Sorry, but disruptive technology will kill banks
Sorry, but disruptive technology will kill banks

Allegedly, John Authers recently wrote an article in the Financial Times entitled “Disruptive technology will not kill banks“. I say allegedly because despite the article being cited and commented on by two people whose analysis and opinion I respect (Chris...

Get ignited with Apache Spark – Part 1
Get ignited with Apache Spark – Part 1

Spark began life in 2009 as a project within the AMPLab at the University of California, Berkeley. More specifically, it was born out of the necessity to prove out the concept of Mesos, which was also created in the AMPLab. Spark was first discussed in the Mesos white...

8 best python Data Science books to read

Python is probably the programming language of choice (besides R. for data scientists for prototyping, visualization, and running data analyses on data sets. There are many libraries, applications and techniques to analyze data in Python that even experts in the field...

The minimalist guide to Google Analytics

Google Analytics is a powerful tool, but it is too difficult to learn as there are lot of features in it. This is the common misconception that most people have while getting started in Google Analytics. Google Analytics is not as difficult as you think. In this post,...

Eight key skills of a successful Data Scientist

With the rise of Big Data in the past few years, a new breed of analysts has gained massive exposure. The so-called "Data Scientists" are considered by many as the only ones capable of leveraging the true value of Big Data. Although it has now become clearer what to...

It’s too late; banking is already being disrupted

Bankers may be taking undue solace in Chris Skinner’s blog post, “Like Airlines and Pharma, Banking’s Too Big to Disrupt.” I was party to the specific round of sparring he cites in his article over whether financial technology startups will overthrow the banking...

How much should Business Intelligence cost?
How much should Business Intelligence cost?

With the New Year just around the corner, it’s time to start preparing for a productive year–which for many businesses means confronting their big and scary data. In fact, “organizing scattered and large data sets” is one of the top business challenges that companies...

Privacy debates: The two axes that govern them

I recently read an article on Tech Crunch about Apple’s public pro-privacy stand, and Snowden’s recent public appearance on Twitter. These two events may not seem related. However, to quote the article, “pro-privacy moves by mainstream tech giants can absolutely chart...

Privacy debates: the two axes that govern them

I recently read an article on Tech Crunch about Apple’s public pro-privacy stand, and Snowden’s recent public appearance on Twitter. These two events may not seem related. However, to quote the article, “pro-privacy moves by mainstream tech giants can absolutely chart...

Why bad data is wasting your marketing efforts

The amount of money spent on marketing is growing, and the way we spend is changing. The statistics that prove this are plentiful and becoming more convincing as the years go by. Here are two very compelling examples: By 2016, we expect the amount of money spent on...

The age of the cockroach

I read an article, The Age of the Cockroach, on Medium and found myself completely agreeing with it. In fact, it hit a sweet spot. We all know there’s a lot of money chasing that all B2C internet and e-commerce start-ups need to do. These investments however happen at...

Can businesses profit from data quality?

We often refer to business data as an asset. Data is essential for every function in an organization, so it’s easy to see why it’s so valuable and vital. On our blog, we’ve discussed ways that clean data can make an organization more efficient and profitable. And we...

How banks can power their loyalty programs
How banks can power their loyalty programs

I read an article on The Huffington Post the other day, about how unhappy Canadians are with their banks’ loyalty programs. It got me thinking about what Crayon is offering to the world, and just how much the world needs it. There are a lot of loyalty programs out...

How banks can power their loyalty programs

I read an article on The Huffington Post the other day, about how Canadians are unhappy with their banks’ loyalty programs. It got me thinking about what Crayon is offering to the world, and just how much the world needs it. There are a lot of loyalty programs out...

Notes from the Centre of the Universe

About a month ago, we set up the New York office of Crayon, the big data startup that I’ve co-founded. I was wading through a mass of summer tourists at Times Square, to get to my office on Broadway & 48th. Right up ahead of me were a bunch of European teenagers....

30 best tweetable quotes about Data Science

To inspire you, we've chosen some of our favorite tweetable quotes about Data Science to share with you. Read on to get inspired and share your favorites with others. The big technology trend is to make systems intelligent and data is the raw material. ~ Amod Malviya,...

Relational vs Non-Relational data bases – Part 3
Relational vs Non-Relational data bases – Part 3

In the first and second part of this blog series, we saw some basic differences between the scalability of Relational and Non-Relational Databases. In this post, I will show you how to use these databases correctly, and also tell you about some well-known companies...

Relational vs Non-Relational data bases – Part 3

In the first and second part of this blog series, we saw some basic differences between scalability of Relational and Non-Relational Databases. In this post, I will show you how to use these databases correctly, and also tell you about some well known companies that...

Top 10 Indian Data Scientists you should know

Education: Applied Mathematics, University of Maryland College Park Expertise: HPC, Statistical Techniques, Machine Learning, Data Mining Vertical: Government DJ Patil is one of the top global leaders of data science, who co-coined the term ‘data scientist’. He is the...

A road map to become a Data Scientist
A road map to become a Data Scientist

I receive a lot of questions regarding which books one should read to become a Data Miner/Data Scientist. Here is a suggested reading list, and also a proposed RoadMap(apart from the requirement of having an appropriate University degree) to become a Data Scientist....

Hong Kong has 'RISE'n

The Web Summit, billed as one of the “best tech conferences on the planet” by Forbes, has long been considered the gold standard in technology events. In July 2015, TWS decided to host its inaugural Asia-focused tech conference RISE in Hong Kong. And I got to go for...

How to use the information collected for your business

The information collected by your business is likely to be stored on large servers, and you collect thousands of files a day. There is so much information that all the information cannot be used all at once, but your business can use the information at a right time....

A simple introduction to Data Science!
A simple introduction to Data Science!

When you hear the term data scientist, what do you think of? If you’re like most people, you might think of something incredibly complex, with statistical terms and programming languages that are beyond comprehension. You might think that only Ph.D.’s in computer...

The one language every Data Scientist must master

When business leaders read about (and tackle) big data, there is a lot to take in. The field is growing so dynamically that many of the industry buzzwords would not have existed a few years ago. Just a short list of some programming languages is enough to make most...

Every day has its dog

While the world has paw-marked just one day of the year to celebrate dogs everywhere, our endearing four-legged friends of Crayon may have a different tail to tell. We don’t necessarily need a day to honour the canine kind at Crayon. We celebrate them in small ways,...

Why business strategy always trumps Data Analytics

There's a lot of hype in the business communities about data, analytics, cloud technologies, data science, and e-commerce. A cornucopia of jargon that emphasizes data (raw material) and its analytics spinoff (the service). Or is it emphasizing business? What came...

Free cheat sheet to become a successful Data Scientist

Big Data, Data Sciences, and Predictive Analytics are the talk of the town and it doesn’t matter which town you are referring to, it’s everywhere, from the White House hiring DJ Patil as the first chief data scientist to the United Nations using predictive...

New-age cab services, Venture financing and more

I took an Uber taxi ride last week to Indiranagar (Bangalore). My car was at the garage for repairs and I had a digital wallet balance to consume. The cab was a brand new Maruti Swift Dzire, and I was concerned that the man behind the wheel was just as new to driving!...

New-age cab services, Venture financing and more

I took an Uber taxi ride last week to Indiranagar (Bangalore). My car was at the garage for repairs and I had a digital wallet balance to consume. The cab was a brand new Maruti Swift Dzire, and I was concerned that the man behind the wheel was just as new to driving!...

The Rise Of The Chief Data Officer

Sometimes change has to be accompanied by numbers. That is the foundation on which the Big Data revolution is built. Without their reassuring presence, there would be little progress. Cold hard numbers are what make the world of business go round. Big Data is...

Statistics Denial Myth #4, Rebranding Predictive Modeling
Statistics Denial Myth #4, Rebranding Predictive Modeling

This is the eighth instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. "The only useful function for a statistician is to make predictions, and thus provide a basis for action." — W....

Data makes us feel good (That is bad)
Data makes us feel good (That is bad)

Sometimes it feels like “numbers” and “facts” have taken the place of feelings as our main decision-making mechanism. If our gut tells us one thing, but the numbers suggest another thing, many of us will be swayed by the cold hard facts. There is something substantial...

Three ways data-driven marketing drives higher ROI

At the heart of good marketing is data. And when data drives your marketing, the average return on investment (ROI) is a whopping 224%! (VB Insight) VB Insight surveyed over 3,000 marketers and looked at tools used on over 3 million websites. Even small improvements...

Big data meets design: Visual communication in big data

A chance encounter with Crayon's co-founder Srikant Sastri in Colombo in 2012, led to my introduction to Crayon's founder Suresh Shankar in Singapore. It took just a few meetings with Suresh, for me to realize that he is a visual story teller. In strict technical...

Big Data and privacy: big deal or not?

Big Data is trending, and will certainly remain so for quite some time, as I see it at least. And yes, Big Data does certainly open lots of possibilities and opportunities. No doubt about that. So let me be clear (especially since I am a lawyer): I am a big fan of Big...

Big data vs bad data: Impact on enterprises

This is the elephant in the Big Data room…. How much “Bad Data” is out there? Wait a minute, I hear you say, do you mean to say that not all of this data is accurate? What is the point of salivating over terabytes of Big Data if we don’t understand which bits are...

6 reasons why I love data and analytics

I must confess that big data analysis wasn’t exactly on my radar when I started engineering at IIT Roorkee. In fact, I started out as a paper and pulp technology major. I soon lost interest in my regular classes and started to work on other projects instead. My first...

Statistics Denial Myth #2, Traditional Practice Straw Man

This is the sixth instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. Myth #2: Statisticians (and other quants), work within 'traditional statistics’ The myth that statisticians only...

Allreduce (or MPI) vs. Parameter server approaches

In the last 7 years or so there has been quite a bit of work on parallel machine learning approaches, enough that I felt like a summary might be helpful both for myself and others. In each case, I put in the earliest known citation. If I missed something please...

Inside a consumer’s mind with Text Analytics

In this post, I will walk you through an example on how we can choose a concept, extract what users write about this concept on Twitter, get insights on how consumers think/behave about it and finally group similar consumer thoughts and experiences using Cluster...

So… What is Deep Learning?

Imagine a baby coming into the world. From the moment she opens her eyes, there is a world of learning to absorb. Every action will create an imprint on her brain, and she will not stop learning until the moment she leaves the world. She develops because of her...

Sales Funnel visualization with R

Sales (purchasing or conversion) Funnel is a consumer-focused marketing model which illustrates the theoretical customer journey towards the purchase of a product or service. Classically, the Sales funnel includes at least four steps: Awareness– the customer becomes...

Statistics Denial, Best Statistical Practice

This is the fourth instalment in the series of essays on Statistics Denial by Randy Bartlett, Ph.D. To read other articles in the series, click here. "I keep saying that the sexy job in the next 10 years will be statisticians" — Hal Varian "I keep saying that...

Cohort analysis with R – "layer-cake-graph"
Cohort analysis with R – "layer-cake-graph"

Cohort analysis is one of the most powerful and popular techniques available to marketers for assessing long-term trends in customer retention and calculating lifetime value. If you studied custora’s university, you would be amazed by the “layer-cake graph” they...

Your privacy force Field for the Internet of Things

The Internet of Things will teach us all a broader view of privacy as much about what is coming at you as what is taken from you. Daniel Solove, the world’s greatest privacy influencer, just provided a beautiful summary of the wonderfully comprehensive and practical...

Three reasons why business users may want to learn Hadoop
Three reasons why business users may want to learn Hadoop

Big data is a popular topic these days, not only in the tech media, but also among mainstream news outlets. Executives see Big Data as providing significant business benefits – greater insight and learning, the ability to obtain answers and make decisions faster and...

Top 10 R packages for Machine Learning

Needless to say, R is one of the most efficient and effective tools for analysing and manipulating data for statistical purpose. To add to that, R being both inexpensive and beautiful, embellishes both the art of programming and proliferating the skill set of the...

Some banks – quietly – use big data
Some banks – quietly – use big data

Banks have been slow to use the data they possess, but now a few are venturing into big data, although without much fanfare. Abhi Mehta, CEO of big data specialist Tresata, said one problem is that most bankers don’t understand technology while IT people don’t...

Making data meaningful in major league baseball

My father played professional baseball for the Chicago White Sox and Cleveland Indians in the 1920’s and 1930’s. This was in the days of Ty Cobb and Babe Ruth, and long before anyone ever heard of computers or even the word, data. However, that did not mean the...

How to make a billion dollars from Big Data

Among the new faces making their debut on the Forbes 2015 billionaires list are a growing number who have made their fortunes from Big Data. These Big Data billionaires are at the top of their game – all of them have built empires on their ability to collect,...

Big Data to prevent crime; cyber stop & frisk risk?

Even casual observers are well aware that Big Data is frequently used to create targeted ads, to recommend products for purchase by online shoppers, and to suggest connections on social networking sites. But people may not be aware that Big Data has become an...

Top 5 groups of Data Scientists: Which group are you in?

A data scientist is someone who performs statistical analysis, data mining and retrieval processes on a large amount of data to identify trends, figures and other relevant information and help a business gain a competitive edge. But, are all the data scientists same?...

What everybody ought to know about a Data Scientist
What everybody ought to know about a Data Scientist

A few years ago, The Harvard Business Review hailed the role of data scientist "The sexiest job of the 21st century”. But do you know what it means to be a data scientist? Well, let's first look into some of the most famous quotes by experts on data science and data...

Decoding Dimensionality Reduction, PCA and SVD

Every day IBM creates 2.5 quintillion bytes of data and most of the  data generated are high dimensional. So it is necessary to reduce the dimensions of the data to work efficiently. One of the most common dimensionality reduction technique is filtering, in which you...

Is Spark better than Hadoop Map Reduce?

For anyone who gets into the Big Data world, the terms Big Data and Hadoop become synonyms. As they learn the ecosystem along with the tools and their workings, people become more aware about what big data actually means, and what role Hadoop has in the big data...

Simplifying choices for the world

This article appeared on iesingapore.gov.sg Crayon Data, a Singapore-based big data company, is touted as one of the fastest growing in Asia. To date, it has raised US$7million in funding, and has also bagged prestigious industry awards such as the TiE Silicon...

The death of search and the rise of choice engines

Some 16 odd years ago, Google made search engines famous and ubiquitous. It’s sell-by date has come. Think about it. Search was the greatest thing in the world because it achieved Google’s wonderful vison of ‘organising the world’s information’. But now… what is the...

Frequently updated Machine Learning blogs

Are you looking for some of the frequently updated Machine Learning blogs to learn what's happening in the world of Machine Learning and related areas that explore the construction and study of algorithms that can learn from data and make predictions or decisions?...

How much of your customer’s data is actionable?

In one of my previous posts, I talked about how showrooming is causing offline retailers to lose business and how big data can help them attract and retain their customers. If they are your regular customers who have the store’s loyalty points card and if you’re...

What is Clustering in Data Mining?
What is Clustering in Data Mining?

Clustering is the grouping of a particular set of objects based on their characteristics, aggregating them according to their similarities. Regarding data mining, this methodology partitions the data implementing a specific join algorithm, most suitable for the...

Visualizing your MP3 music collection
Visualizing your MP3 music collection

In this article we'll explore a neat way of visualizing your MP3 music collection. The end result will be a hexagonal map of all your songs, with similar sounding tracks located next to each other. The color of different regions corresponds to different genres of...

Five ways to get started with Big Data

Remember what life was like before big data? The term has become so prevalent in the business lexicon that sometimes it’s hard to remember that big data is a relatively recent phenomenon. Some may have viewed it as a fad, but data generated by people, processes and...

Using data analytics to improve diabetes prevention

Many companies and research groups are working to treat diabetes, but preventing the disease will have a greater impact on health in at-risk groups. A team of US researchers are using data analytics to create a precision medicine approach to prevention of diabetes...

RIP, Anand

It was with deep sadness and sorrow that we received the news of the passing away of our colleague and friend Dr. Anand Ramachandran this morning at 630 a.m IST in Delhi. Anand had been unwell for a while with a respiratory problem, and flew to Delhi about two weeks...

Top 10 data mining mistakes to avoid

Mining data to extract useful and enduring patterns is a skill arguably more art than science. Pressure enhances the appeal of early apparent results, but it’s too easy to fool yourself. How can you resist the siren songs of the data and maintain an analysis...

How Big Data is changing recruitment forever
How Big Data is changing recruitment forever

It used to be said that employers made up their minds whether or not to hire a prospective candidate within 5 minutes of sitting down to interview them. It’s hard to say if this is true or not, but many people in positions with responsibility for hiring would probably...

Big Data – A new steroid in Tennis?

Gone are the days when the coaches used to sit and collect information during a live match and later looked for patterns and insights in the data that might help them make better decisions for future matches. Today, coaches have the two basic ingredients for sports...

Building a Taste Graph: The basic principles
Building a Taste Graph: The basic principles

This is the second part of Vijaya Kumar Ivaturi’s earlier post Big Data - Not just a matter of scale: 5 new trends and twists. In my previous post, we have discussed about five new trends, twists and some key differences in big data analytics in terms of its...

A Taste of Choice: Building a Taste Graph

This is the second part of Vijaya Kumar Ivaturi’s earlier post Big data analytics – Not just a matter of scale. “It is in the above context that the recent advances in recommender systems need to be viewed. The use of graph based systems for solving social and...

Top 5 best choices of Business Management software
Top 5 best choices of Business Management software

Whether the company you are running is large or small, it is essential that you stay on top of your day-to-day responsibilities. The right software can play an important role in boosting efficiency in the workplace. We have done the hard work comparing the different...

Top 15 Indian Big Data companies to watch out for in 2015
Top 15 Indian Big Data companies to watch out for in 2015

As the data we generate every micro-second grows and accelerates at a rapid velocity, the requirement for making a business decision is shifting from hindsight-based decision making to a foresight-based approach. Companies are banking upon Big Data and analytics. ...

Big data analytics – Not just a matter of scale

Follow effective action with quiet reflection. From the quiet reflection will come even more effective action. Peter Drucker It is only when you reflect on your experiences do they translate into learning. And so, having been in the technology space for close to three...

Top 12 common problems in Data Mining
Top 12 common problems in Data Mining

The amount of data being generated and stored every day is exponential. A recent study estimated that every minute, Google receives over 2 million queries, e-mail users send over 200 million messages, YouTube users upload 48 hours of video, Facebook users share over...

Three ways to overcome the lack of right data in India
Three ways to overcome the lack of right data in India

The digital footprint of society is expanding the world over into fragmented mediums (blogs, tweets, reviews etc) and technologies (mobile, web, cloud/SaaS etc). Data generated from mobile devices and the internet of things are the main contributors to this data...

Top 10 heatmap analytics tools for marketers

Heatmaps are the best means to visualize complex data sets. Used to easily understand and analyze large amounts of multi-dimensional data, they are the simple graphical representation of data in which values are represented by colours. In this article, we present top...

Top 15 social media analytics tools for marketers

Social media analytics tools are like life-sustaining organs for marketing professionals, as they are the simple ways for them to identify what’s happening around them in the digital world, especially in social media channels. Before they spend even a single penny...

The Death of Search

Some 16 odd years ago, Google made search engines famous and ubiquitous. It’s sell-by date has come. Think about it. Search was the greatest thing in the world because it achieved Google’s wonderful vison of ‘organising the world’s information’. But now… what is the...

Top 10 interesting facts & tips about MySQL

MySQL is the fastest growing open-source relational database management system with 100 million downloads till date. It is a popular choice of database for use in web applications and is currently used by many large websites, including Facebook, Twitter, Wikipedia,...

Three steps to become an “Analytics Superstar”SAUR

The value of analytics education is skyrocketing – thanks to the raising need for analytics professionals to process and analyze the vast amount of digital data being generated everyday by individuals and companies. Plenty of degrees, software tool trainings, online...

The O Alliance Announces Newest Affiliate: Crayon Data

his news story appeared in Yahoo News NEW YORK: The O Alliance today announced the addition of Crayon Data to its network of world-class, transformational Affiliate members, with expertise in key areas designed to support retailers’ efforts to unlock value and achieve...

15 best books to learn Probability & Statistics

Probability theory is the mathematical study of uncertainty. It plays a central role in machine learning, as the design of learning algorithms often relies on probabilistic assumption of the data. Now, are you searching for some good books in Probability to read? Here...

Is Big Data a game changer for offline retail stores?

Remember the time you went to an electronic shop near you to see how it feels like to hold a Samsung Galaxy Note 2 with a 5.55 inch touch screen and what titanium grey looks like? Or to a branded garment store to see for yourself the difference between crimson and...

Popular web analytics tools for online businesses

Web analytics tools are used by online businesses and market researchers to collect and measure web traffic data for the purpose of understanding and improving the effectiveness of a website. The most commonly used metrics in web analytics reports are: unique...

Key Big Data predictions and trends for 2015

2014 was big for big data and 2015 is going to be even bigger. There are lots of predictions coming about big data technologies in 2015 and here is a look at some of the key predictions by big data experts around a globe. Customers will gain more control over the use...

The search for Long Johns in cold New York

It is minus 13 °C in New York City (with the wind chill), and I feel woefully unprepared for the cold. I immediately head to the Uniqlo store on 5th Avenue - to check out their Heattech vests, long johns and socks. They are out of long johns. A sales associate tells...

Is 2015 truly ‘The Year of Big Data’?

Will big data transform education in 2015? Will big data make government more transparent? Will big data and analytics make tremendous progress this year in the form of emerging technologies, adoption of data-driven decision making, and scientific breakthroughs? Will...

The Best Data Visualizations of 2014

It's always tough to pick my favorite visualization projects. I mean, it's a challenge to pick and rank your favorite anything really. So much depends on what you feel like at the time, and there's a lot of good work out there. Nevertheless, I gave it a go. These are...

You Need an Algorithm, Not a Data Scientist

Mark Twain once said: “The past does not repeat itself, but it rhymes.” Although future events have unique circumstances, they typically follow familiar past patterns. Today, data scientists can predict everything from disease outbreaks to mortality to riots. It’s no...

EmployABILITY – A perception changing experience

Crayon Data recently participated in EmployABILITY – a job fair for differently able people. We were one among the 35 companies (J P Morgan, Reliance, Wipro, PayPal etc.) who participated in the event, looking for the candidates suitable to their requirements. As many...

Irish flair + start-up energy, fuels the Web Summit

Jottings from the Web Summit (November 4-6, Dublin) Four of us from Crayon Data attended the Web Summit for the first time this year. Unsure of what to expect when we went in, it proved to be an unforgettable experience – here are some perspectives. A watering hole...

How Hospitality Industry is Leveraging the Big Data?

Appeared on hospitalitybizindia.com Data has become an integral part of our society today. Widespread use of the Internet, social media, location-based services and multimedia are contributing to the ever-growing data explosion that is generating information about...

22 tips for better Data Science
22 tips for better Data Science

These tips are provided by Dr. Granville, who brings 20 years of varied data-intensive experience working with successful start-ups, small companies across various industries, and eBay, Visa, Microsoft, GE and Wells Fargo. Tips for better Data Science 1. Leverage...

Exploring 5 big data training programs
Exploring 5 big data training programs

With big data expertise in high demand, both universities and private companies are ramping up their education programs and big data training. Gartner expects that the BDA market will have 4.4 million jobs available by 2015, but only about one-third of them will be...

Top 7 tips to succeed with Big Data in 2014
Top 7 tips to succeed with Big Data in 2014

Just when you thought big data couldn’t get any bigger, it got bigger still. Regardless of its actual size, big data is showing its value. Organizations everywhere have big data of all shapes and sizes. They recognize the importance, the opportunity, and even the...

Eye-opening facts everyone should know about Big Data

We surely see a lot of hype surrounding big data but I believe the following 25 facts speak for themselves and help to paint a realistic picture of the phenomenon we now call ‘Big Data’ - a phenomenon that is changing the world as we know it. 1. Every 2 days we create...

Top 10 ways to improve your data center energy efficiency

Many organizations have seen their storage requirements explode over the last few years, with total storage capacity growing at a compound annual growth rate of 53%, according to IDC. With that growth comes a corresponding increase in storage-related energy costs, but...

Nostradamus on Big Data: 5 predictions

It's almost 450 years since Nostradamus wrote his best-seller, 'Les Propheties, and gave everyone sleepless nights ever since. What predictions would he make today about Big Data in the 2015-2020 era? Prediction#1: The oppression "The hapless consumer will be troubled...

How Big Data helps me find my shoes!
How Big Data helps me find my shoes!

I just got an email from an ecommerce website: they are offering a discount of 30% over and above the regular discounts for this weekend. I decided to check the site – on my phone – for a pair of casual shoes that I’ve been planning to buy. There were 3640 options –...

9 ugly lessons about sex from Big Data!
9 ugly lessons about sex from Big Data!

Big Data: the friend you met at a bar after your usual two drinks, plus one. You leaned in, listening more intently than usual. “Digital footprint.” “Information Age.” You nodded and smiled, even though you didn’t understand. “Change the world.” “The future.” You were...

How to fight claims fraud with big data?
How to fight claims fraud with big data?

In today's highly competitive marketplace, most insurance companies have already streamlined their operations to optimise cost structures. Commoditisation of markets and lower investment returns are keeping pressure on insurers to tightly manage expense ratios....

Can you find true love through big data?
Can you find true love through big data?

The history of the algorithm for dating websites date back to mid-1960s, where there was a computer service, where participants punched holes into a set of questions and a computer processed the questions from different participants and returned matches. The first...

Top 20 Big Data jobs and their responsibilities
Top 20 Big Data jobs and their responsibilities

Big Data is spreading much excitement in the IT job market worldwide and according to Gartner, by 2015, 4.4 million IT jobs globally will be created to support big data, generating 1.9 million IT jobs in the United States alone. Check out our list of top 20 Big Data...

What is Big Data: Definitions from 40+ thought leaders
What is Big Data: Definitions from 40+ thought leaders

“Big Data.” It seems like the phrase is everywhere. The term was added to the Oxford English Dictionary in 2013, appeared in Merriam-Webster’s Collegiate Dictionary by 2014, and Gartner’s just-released 2014 Hype Cycle shows “Big Data” passing the “Peak of Inflated...

Seven common problems of scaling Hadoop

Every Hadoop implementation encounters the occasional crisis, including moments when the folks running Hadoop feel like their hair is on fire. Sometimes it happens before you get to production, which can cause organizations to throw the Hadoop baby out with the...

5 questions all marketers should ask their Big Data

We hear this often: big data means big headaches for marketers due to the overwhelming volumes of information that are hard to sort through to find the right data that is then actionable. In many organizations, only a data scientist or analyst can make sense of this...

Big Data – An ultimate weapon in the field of sports?
Big Data – An ultimate weapon in the field of sports?

Sports has always been associated with tons of statistics about players, teams, and performances, and this information has been used to a limited extent in the past to improve games. Today, the picture is completely different thanks to big data, the technology that...

8 important things to remember while mining data

1. Having a clearly-defined and measurable objective for a project in mind Data mining is often a difficult and time consuming task. Hence, not having a clear idea how to mine the data will severely affect the project’s focus. So having a clear idea of what, how and...

Biggest big data security breaches since 2010

All businesses and organizations have legal and ethical responsibilities to safeguard their confidential data as well as their customers’ personal information, but data breaches happen all the time! According to the Online Trust Alliance's (OTA) 2014 Data Protection...

Hadoop Glossary: 20 most important terms
Hadoop Glossary: 20 most important terms

This is a list of most important Hadoop terms you need to know and understand, before going into the Hadoop eco-system. [To read about top 10 most popular myths about Hadoop, click here.] Most important Hadoop terms Apache or Apache Software Foundation (ASF): A...

How to monitor migration trends using Big Data?
How to monitor migration trends using Big Data?

Monitoring migrations is not an easy task. While in today’s economy, survey data about economic confidence or public opinion are collected on a daily basis, that is not the case for migration statistics, which come from Censuses, population registers, and,...

Top 10 best free Cloud Storage services for personal use
Top 10 best free Cloud Storage services for personal use

Are you looking top Cloud Storage services to store your videos, music, movies, photos and files and access them from anywhere on the go through internet? Here is our list of top 10 Cloud Storage services where you can keep your data safe and avoid the risk of a...

Climate change is here to stay, says Big Data

By now, most sci­en­tists—97 per­cent of them, to be exact—agree that the temperature of the planet is rising and that the increase is due to human activities such as fossil fuel use and defor­esta­tion. But until recently, the jury was still out regarding the...

Neglected machine learning ideas

This post is inspired by the “metacademy” suggestions for “leveling up your machine learning.” They make some halfway decent suggestions for beginners.  The problem is, these suggestions won’t give you a view of machine learning as a field; they’ll only teach you...

What is BI? Best books on Business Intelligence

We live in the age of data and data is powerful, if we make sense of it. Business Intelligence is a solution that helps us see what is hidden in data. It uses data about yesterday and today to make better decisions about tomorrow. As Swain Scheps defines it, "Business...

Data Security: A talk with Gregory Shapiro
Data Security: A talk with Gregory Shapiro

As a key protagonist in the Big Data movement, Gregory Shapiro’s website KDNuggets has become one of the most influential places to find new information and developments within data. As a prominent figure in the data revolution, he has seen himself and his website...

12 best TED videos on Data Visualization

Visualization is critical to data analysis. Data by itself, consisting of bits and bytes stored in a computer hard drive, is invisible. In order to be able to see and make any sense of data, we need to visualize it. Watch these TED videos to get deep insights on Data...

Deep dive into NoSQL: A complete list of NoSQL databases
Deep dive into NoSQL: A complete list of NoSQL databases

NoSQL is an alternative to traditional relational databases in which data is placed in tables and is useful for working with large sets of distributed data. It is designed to accommodate a wide variety of data models, including key-value, document, columnar and graph...

5 ways Big Data is changing Real Estate
5 ways Big Data is changing Real Estate

Real estate has traditionally been a game won or lost based on old-fashioned networking and shoe-leather style hard work — deeply dependent on timing, detecting trends and more than a little bit of luck. It may not be that way for much longer, however. Big data is...

Top 20 essential Hadoop tools for crunching Big Data
Top 20 essential Hadoop tools for crunching Big Data

Hadoop is an open source distributed processing framework which is at the center of a growing big data ecosystem. Used to support advanced analytics initiatives, including predictive analytics, data mining and machine learning applications, Hadoop manages data...

5 things Big Data CAN do in cancer research
5 things Big Data CAN do in cancer research

There’s a treasure trove of data locked away in medical records and scientific studies that, if liberated and used appropriately, could help to improve cancer care. Big data is not a new concept – it’s actually been changing the face of medicine for years. The best...

20 must read books for budding data scientists
20 must read books for budding data scientists

A data scientist is a professional who connects the dots between the business world and the data world. Data science is the craft that a data scientist utilizes to make this happen. In other words, Data Science is a study which deals with identification,...

5 R training programs for developers

There’s little surprise in seeing Java top the list of popular programming languages for 2014, but another language is gaining traction. R, the free software programming language and developer environment for statistical computing and graphics, cracked IEEE Spectrum’s...

Top five advantages and challenges of NoSQL
Top five advantages and challenges of NoSQL

For a quarter of a century, the relational database (RDBMS) has been the dominant model for database management. But, today, non-relational, "cloud," or "NoSQL" databases are gaining mindshare as an alternative model for database management. In this article, we'll...

5 fun facts you may not know about HBase!

Here are some facts you may not have known about HBase: 1. Many companies have had HBase in production for 3+ years: Large technology companies including Trend Micro, EBay, Yahoo! and Facebook, and analytics companies RocketFuel and Flurry depend on HBase for many...

Top 24 best books on Data Mining and CRM
Top 24 best books on Data Mining and CRM

There are a lot of books about data mining and CRM. This list contains what I think are the best. 1. Data Mining Techniques: For Marketing, Sales, and Customer Relationship Management Michael Berry & Gordon Linoff / Paperback / 2004 (Revised Edition) An excellent...

Does your HR department have a data scientist?
Does your HR department have a data scientist?

According to a recent report by  SilkRoad, 65 percent of human resources professionals surveyed said one of the biggest problems faced by companies that don't have HR tasks "integrated with automated systems" is a lack of critical data and analytics. To solve this...

Top 10 books to get started with Hadoop
Top 10 books to get started with Hadoop

These books are our recommendations if you are planning to start your Big Data journey with Hadoop, - an open source distributed processing framework which is at the center of a growing big data ecosystem. The books are listed in no specific order. 1. Hadoop: The...

The Ten Commandments of Big Data
The Ten Commandments of Big Data

1. Thou shalt decide on a business problem before committing any time, money, or animal sacrifice to the project. 2. Thou shalt start small and build, committing not to cataloging the Internet on thy first project. 3. Thou shalt not spend unnecessarily. Open Source...

Learning Data Mining: 12 books on R

R is a free and widely used programming language for data analysis and statistics. It is a dynamically typed interpreted language that possesses an extensive catalog of statistical and graphical methods. In this post, we list 12 books to help you learn R and your data...

Top 33 most noted Data Scientists on Twitter

Do you follow these 33 most notable Data Scientists on Twitter? 1. Hilary Mason @hmason Data Scientist in Residence at @accel. I ♥ data and cheeseburgers. 2. John Myles White @johnmyleswhite Scientist at Facebook and Julia developer. Author of Machine Learning for...

Data in crime fighting: Beyond Minority Report

When we discuss Big Data in crime fighting, the analogy of Minority Report, the 2002 Tom Cruise film, always comes up. This is the idea that it would be possible to predict who is going to commit a crime and when meaning that law enforcement can stop these crimes...

Top 25 most popular Data Science blogs

Looking for most popular, frequently updated and insightful Data Science blogs? Here is our list. The  blogs are arranged in no particular order. 1. FiveThirtyEight 2. The Numbers Guy 3. Freakonomics 4. OKCupid 5. DataTau 6. Data Ranker 7. Beyond The Purchase 8. Data...

Learn Hadoop with 10 SlideShare presentations

Want to learn Hadoop? Watch these presentations on SlideShare to understand Hadoop HDFS, the MapReduce algorithm, the Pig Latin language, and the Hive SQL language. 1. Introduction to MapReduce, an Abstraction for Large-Scale Computation by Ilan Horn, Google...

Best LinkedIn groups all Hadoop experts should join

There are hundreds of Hadoop groups on LinkedIn, but these are the best ones you should definitely consider joining. Join them to learn about the latest happenings in the world of Hadoop, and engage in discussions with other professionals online. 1. Hadoop Users Group...

Download 30 papers on Machine Learning

Are you looking for some serious research papers on Machine Learning? Here you go...! 1. Optimized projections for compressed sensing 2. Multiscale sparse image representation with learned dictionaries 3. Robust face recognition via sparse representation 4. Feature...

Big Data and its threat to The Fourth Amendment

John Villasenor, Professor of Public Policy at UCLA, recently projected that it will be possible for governments to record and analyze everything an individual says and does in the near future. In the wake of the NSA revelations you could argue this already exists, so...

Top 17 white papers on Data Science
Top 17 white papers on Data Science

Check out our list of 17 White Papers on Data Science! You can download them by clicking on the links. If we have missed any, please feel free to add. 1. Building Data Science Teams by DJ Patil (2011) 2. Next-Gen Data Scientists by Dr. Rachel Schutt (2013) 3. Keep...

Top 30 simple Data Visualization tools

Data visualization is the presentation of quantitative information in a graphical form. A data visualization tool turns large and small datasets into visuals that are easier for the human brain to understand and process. Now, are you looking for a simple tool to...

Top 30 simple Data Visualization tools
Top 30 simple Data Visualization tools

Data visualization is the presentation of quantitative information in a graphical form. A data visualization tool turns large and small datasets into visuals that are easier for the human brain to understand and process. Now, are you looking for a simple tool to...

Top 30 simple Data Visualization tools
Top 30 simple Data Visualization tools

Data visualization is the presentation of quantitative information in a graphical form. A data visualization tool turns large and small datasets into visuals that are easier for the human brain to understand and process. Now, are you looking for a simple tool to...

Top 35 invaluable books on Data Visualization

Are you a hard-core enthusiast of data visualization? Or a beginner, who wants to learn and be able to create more effective visualisations? Check out our list of 35 invaluable books you must read for better visualization. (Some books in the list might not be directly...

Top 10 most popular myths about Hadoop
Top 10 most popular myths about Hadoop

Hadoop and Big Data are practically synonymous these days. There is so much info on Hadoop and Big Data out there, but as the Big Data hype machine gears up, there's a lot of confusion about where Hadoop actually fits into the overall Big Data landscape. Let’s have a...

Deploying Big Data To Recruit And Retain Talent
Deploying Big Data To Recruit And Retain Talent

Big Data is the buzzword of the year. Every leader — whether they’re managing a small team or are at the helm of a multinational corporation with thousands of employees — is wondering how they can use Big Data to better get to know their people, to create a setting...

Deploying Big Data To Recruit And Retain Talent
Deploying Big Data To Recruit And Retain Talent

Big Data is the buzzword of the year. Every leader — whether they’re managing a small team or are at the helm of a multinational corporation with thousands of employees — is wondering how they can use Big Data to better get to know their people, to create a setting...

How brain science will change computing

Treo creator Jeff Hawkins urges us to take a new look at the brain — to see it not as a fast processor, but as a memory system that stores and plays back experiences to help us predict, intelligently, what will happen next.

How brain science will change computing
How brain science will change computing

Treo creator Jeff Hawkins urges us to take a new look at the brain — to see it not as a fast processor, but as a memory system that stores and plays back experiences to help us predict, intelligently, what will happen next.

The Metaphysics of Big Data: The Problem of Induction

How do we, human beings, acquire knowledge? Think for a second! And don’t tell me that it is from text books, TV, internet or newspapers etc!!! Scholars say that there are mainly (debatably) five valid ways (Perception, Inference, Comparison, Verbal Testimony and...

The Era of Cloud Computing

SynapDx searches hundreds of thousands of genetic markers, looking for clues about autism in 880 children across 20 states. A few years ago, this would be the task of a major company or research institution. Thanks to cloud computing, the start-up in Lexington, Mass.,...

Understanding the power of Hadoop as a Service

Across a wide range of industries from health care and financial services to manufacturing and retail, companies are realizing the value of analyzing data with Hadoop. With access to a Hadoop cluster, organizations are able to collect, analyze, and act on data at a...

A Tour of Machine Learning Algorithms
A Tour of Machine Learning Algorithms

After we understand the type of machine learning problem we are working with, we can think about the type of data to collect and the types of machine learning algorithms we can try. In this post we take a tour of the most popular machine learning algorithms. It is...

A Tour of Machine Learning Algorithms
A Tour of Machine Learning Algorithms

After we understand the type of machine learning problem we are working with, we can think about the type of data to collect and the types of machine learning algorithms we can try. In this post we take a tour of the most popular machine learning algorithms. It is...

Why we’re all so obsessed with deep learning

Summary: Deep learning is all the rage among the tech scene right now, and that’s more a result of its utility than because it sounds cool. Some questioned the feasibility of the Secret Service’s requested “sarcasm detector,” but deep learning could help there, too....

Download 12 Free eBooks on Big Data
Download 12 Free eBooks on Big Data

Are you looking for eBooks to upgrade your knowledge in Big Data, one of the fastest trending stream in IT? Here is a list of 12 FREE eBooks you can download. Happy reading...! Big Data Now Publication: O'Reilly Media Author: O'Reilly Radar Pages: 136 Download Big...

What does a Data Scientist do?
What does a Data Scientist do?

Data Scientists…! We hear about them everywhere around us and there is so much hype around data science, data scientists and the slew of accompanying technologies like Hadoop, Hive, Mahout, Hbase and with keywords like big data, machine learning, information...

What does a Data Scientist do?
What does a Data Scientist do?

Data Scientists…! We hear about them everywhere around us and there is so much hype around data science, data scientists and the slew of accompanying technologies like Hadoop, Hive, Mahout, Hbase and with keywords like big data, machine learning, information...

Re-Imagining the Store of the Future
Re-Imagining the Store of the Future

A couple of months ago, on a trip to the US, I decided to replace my aging MacBook with a MacBook Air. I placed the order online, since I also wanted to soup up the memory and hard disk. While I was at it, I decided to order a “COVER” for the machine. Four days later,...

Who are the top 10 Big Data influencers in 2014?
Who are the top 10 Big Data influencers in 2014?

Big Data has come a long way during the last few years, thanks to the many analysts, researchers, bloggers and innovators. These influencers have explored different ways of implementing big data to improve productivity and the quality of life in our modern societies....

What does a Data Scientist do?

Data Scientists...! We hear about them everywhere around us and there is so much hype around data science, data scientists and the slew of accompanying technologies like Hadoop, Hive, Mahout, Hbase and with keywords like big data, machine learning, information...

Top big data tools used to store and analyse data
Top big data tools used to store and analyse data

BIG DATA is a term used for a collection of data sets so large and complex that it is difficult to process using traditional applications/tools. It is the data exceeding Terabytes in size. Because of the variety of data that it encompasses, big data always brings a...

30 thought provoking Big Data quotes that you should know
30 thought provoking Big Data quotes that you should know

There are plenty of Big Data quotes on the web! But do you know which are the most powerful and thought-provoking ones? Here is a list of 30 best Big Data quotes that you should know. 1. "Big Data is like teenage sex: everyone talks about it, nobody really knows how...

Virtual Reality brings Big Data visualization to life

Data visualization tools have made it somewhat easier to glean intelligence from a mass of information. But today’s tools are still extremely inefficient, as they fail to incorporate the science of human visual perception into their data visualization techniques. This...

Big Data and Analytics In Sports: A Game Changer

If there is one area in which big data is literally guaranteed to be a game-changer, it’s sports. Sports have for a long time been accompanied by a wealth of statistics – what’s different today is the amount of data and the multitude of ways that we have to analyze...

Big Data Banking Is Not Just for Big Banks

All banks, large and small, are swelling with data. The growth in data is not only coming from the traditional relational data stored in product and customer-servicing systems, but in voice call logs, emails, website click streams, and in social media sites. Data...

Nine large problems with big data
Nine large problems with big data

Big data is suddenly everywhere. Everyone seems to be collecting it, analyzing it, making money from it and celebrating (or fearing) its powers. Whether we’re talking about analyzing zillions of Google search queries to predict flu outbreaks, or zillions of phone...

Data Science vs. Statistics – One in the Same?

I recently ran across a thought-provoking post on the USC Anneberg Innovation Lab blog – “Why Do We Need Data Science when We’ve Had Statistics for Centuries.” With all the debate of late surrounding the relatively new “data science” term, I’ve been thinking a lot...

Actually, Every Company Is a Big Data Company

Every day companies collect data about their customers and industries, simply as an artifact of the act conducting business. As I listened to a panel on Big Data yesterday at the MIT Sloan CIO Symposium in Cambridge, Mass., I had an epiphany: every company is a Big...

4 ways eCommerce merchants misuse data!
4 ways eCommerce merchants misuse data!

The use of customer data can help you make smarter decisions that can improve your store, enhance the shopper experience, and increase conversions. When used incorrectly, however, data can waste resources and alienate your visitors. Below are four ways that ecommerce...

Crayon Data gets global recognition

India (Chennai) and Singapore based Crayon Data has been declared winner at TieCon 2014 held at Santa Clara US, in which it competed with top 50 global technology startups, shortlisted from 2800 companies worldwide. The start-up has been getting attention lately at...

Deconstructing Taste – The Crayon Way

Crayon’s product manager Ajay Kashyap explains how Crayon’s proprietary taste algorithm helps in understanding customer taste in a holistic way; not bounded by traditional constraints of category, availability, costs and location proximity, in conversation with...

Why you still don’t need a chief data officer

For those who have followed my writings on the subject of the chief data officer (CDO), you know well that I am no advocate of this role. Having endured one wave of hype after another on this subject and being that I just attended the CDO Summit in London, I felt that...

Big Data meets big-time basketball

Not long ago, if the Los Angeles Clippers had wanted to figure out how to best defend Warriors star guard Steph Curry, they might have sent a scout to a game or watched video clips. For their recent first-round playoff matchup, they had another way. As of this year,...

Big data needs to be more than just expensive noise
Big data needs to be more than just expensive noise

For all the vaunted potential of big data, the consumer benefits aren’t fully apparent yet. Netflix still recommends me movies I don’t want to watch, Spotify still nudges me towards bands I don’t particularly like and most of the companies targeting ads at me on...

Do We Still Need Database Design in the Era of Big Data?

Many big data application implementations seem to begin with an existing data warehouse, one or more new high-volume data streams, and some specialized hardware and software to support data storage and business analytics. The data storage issue is often accommodated...

The future of Big Data is linked to Cloud
The future of Big Data is linked to Cloud

Data volumes are growing exponentially. Unstructured data from Twitter, LinkedIn, Mailling Lists, etc. has the potential to transform many industries if it could be combined with structured data. Machine learning, natural language processing, sentiment analysis, etc....

Big data brings new power to open-source intelligence

In November 2013, the New Yorker published a profile of Eliot Higgins – or Brown Moses as he is known to almost 17,000 Twitter followers. An unemployed finance and admin worker at the time, Higgins was held up as an example of what can happen when we take advantage of...

Can big data predict the next cyber attack?

The battle to secure private data, whether financial information or intellectual property, may be won through big data analysis. That, at any rate, is what Bob Griffin, cybersecurity firm RSA’s chief security architect, thinks. “The ability to take massive volumes of...

Re-Imagining the Store of the Future – Part II

You are in a department store. After waiting in line, you get to the fitting room - and try out the outfit you've picked out. You love it, except…..it’s the wrong size. You now have to change back into your clothes - go out pick the right size, and get back to the...

Why Machine Learning Matters

Like it or not big data is here to stay. While some businesses may have been skeptical or intimidated at the prospect of incorporating big data into their operations, the reality is that without big data analytics, a company is likely to fall behind its competitors....

Defining Big Data
Defining Big Data

As the field of big data grows, increasing numbers are introduced to its concepts, and I often hear the basic question of “is my data big enough to be big data?” Seven terabytes? Seventy terabytes? Seven hundred? It’s too late now to change the name, of course, but...

Hadoop, big data, and the elephant in the room
Hadoop, big data, and the elephant in the room

In the 1800s, John Godfrey Saxe wrote a poem about six blind men and an elephant based on an old Indian story. In an effort to discover what the elephant is, each man touches a different part of the creature and subsequently draws his own unique — and incorrect —...

Are medical devices safe?
Are medical devices safe?

Medical device cybersecurity issues arrive at the Heart Rhythm Society's annual meeting, with reps from industry and regulation making the case for collaboration in the interest of patient safety. It'll take a village to ensure that medical devices are ready to face...

How Big Data Builds The Sensor Society
How Big Data Builds The Sensor Society

As our cars, phones and computers get “smarter” they — and the companies that provide them — know a lot more about us than they used to. A large part of this data collection stems from the fact that these devices act as sensors, collecting information we’d probably...

Maya from Crayon Data shortlisted for IBM challenge

Crayon Data, a new generation big data analytics company focused on simplifying the world’s choices, announced it has been selected as one of the top list of companies for the IBM’s Watson Mobile Developer Challenge. The short list allows Crayon’s entry, the Maya...

How Big Data Influences Design
How Big Data Influences Design

Big data is influencing every aspect of our lives, both on and offline. On Friday, May 2, Umbel joined IBM, along with Peter Kim, to talk about how the big data revolution is affecting design. In the 30 minute talk, held monthly by IBM's David Pittman, we touched on...

Can big data save horse-racing industry?
Can big data save horse-racing industry?

On Saturday, May 3, the 140th running of the Kentucky Derby took place. Twenty 3-year-old Thoroughbreds took a 1.25-mile sprint in what is commonly referred to as “The Greatest Two Minutes in Sports.” For casual horse-racing fans, the Derby is likely one of only a...

45 surprising facts about big data!
45 surprising facts about big data!

What will Big-Data convey with some of it’s startling factoids. I recently ran through google to find some good factoids. I stumble upon some of these facts which are worth mentioning and keeping a note on. 1. Google’s Eric Schmidt claims that every two days now we...

Top 30 simple tools for Data Visualization

There have never been more technologies available to collect, examine, and render data. Here are 30 different notable pieces of data visualization software good for any designer's repertoire. They're not just powerful; they're easy to use. In fact, most of these tools...

Relational Vs Non-Relational databases – Part 2

In my previous post, we have seen some fundamental differences between Relational and Non-Relational databases. In this post, let's talk about Scalability of these two. Scalability It is an ability of a system that can easily accommodate the rapid incoming data...

Can an Algorithm Solve Twitter’s Credibility Problem?

On October 29, 2012, when Hurricane Sandy made landfall, I was in my Brooklyn apartment, refreshing Twitter. The news on my timeline consisted mostly of grim dispatches from amateur storm spotters tracking Sandy’s march up the coast. By the time the storm reached New...

What The Heck Is Machine Learning?

Machine learning is a computer’s way of learning from examples, and it is one of the most useful tools we have for the construction of artificially intelligent systems. It starts with the effort of incredibly talented mathematicians and scientists who design...

Saving Big Data from Big Mouths
Saving Big Data from Big Mouths

SA Forum is an invited essay from experts on topical issues in science and technology. It has become fashionable to bad-mouth big data. In recent weeks the New York Times, Financial Times, Wired and other outlets have all run pieces bashing this new technological...

Re-Imagining the Store of the Future

A couple of months ago, on a trip to the US, I decided to replace my aging MacBook with a MacBook Air. I placed the order online, since I also wanted to soup up the memory and hard disk. While I was at it, I decided to order a “COVER” for the machine. Four days later,...

Big Data & E-commerce

Let’s say you’re walking past a store and your eye catches a fancy gadget that you decide you must have, but you’re in a tearing hurry. So what do you do? You take a picture of the doodad with your smartphone, and hey presto, the store’s technology enables you to get...

How One Woman Hid Her Pregnancy From Big Data

For the past nine months, Janet Vertesi, assistant professor of sociology at Princeton University, tried to hide from the Internet the fact that she's pregnant — and it wasn't easy. Pregnant women are incredibly valuable to marketers. For example, if a woman decides...

Boosting Customer Loyalty with Big Data

Are you paying attention to your existing customers? If not, you may want to reconsider your priorities: According to a new report, more than half of the annual revenue for 61 percent of small business owners comes from repeat buyers. The report found that 80 percent...

How Big Data Could Undo Our Civil-Rights Laws

Big Data will eradicate extreme world poverty by 2028, according to Bono, front man for the band U2. But it also allows unscrupulous marketers and financial institutions to prey on the poor. Big Data, collected from the neonatal monitors of premature babies, can...

You Can Quit Looking for Data Scientists

Data scientists are hard to find and expensive to keep, but that doesn’t mean that big data insights are beyond your reach. And, no, we’re not suggesting that you outsource your most important work to a team of analysts in a distant land. After all, there’s a new...

5 big data Ted Talks everyone needs to watch now

Big data may be a big buzzword, but it's implications are bombarding the business world, offering new insights to old problems and connecting the dots where previously no dots were even seen. It's a changing space out there, where what you like on Facebook can tell a...

Big Data: Your Secret Weapon to Retail Marketing

Big data. You know it’s out there. You know it’s accumulating in mind-boggling volumes and at breakneck speeds. And you know you need to do something about it to drive your retail content marketing efforts. If the words “big data” get your pulse racing, make you toss...

Top 10 tech topics IT leaders should stay on top of
Top 10 tech topics IT leaders should stay on top of

At the Interop conference in Las Vegas a few weeks ago, I noticed some strong trends in the topics covered. As a matter of fact, most of the topics fit into a dozen or so categories. Here are 10 hot topics that are clearly on the minds of business and IT leaders. 1:...

Relational vs. non-relational databases – Part 1

For the past few years, NoSQL or Non-relational database tools have gained much popularity in terms of storing huge amount of data and scaling them easily. There are debates on whether non-relational databases will replace relational databases in the future. With the...

How big data is saving bankers’ bonuses

This year will see the enforcement of the EU’s clampdown on bankers’ bonuses, which requires banks to restrict bonuses to 100% of salary. This has already had a major impact on the market with the likes of HSBC and Goldman Sachs finding ways to circumvent the cap...

Introduction to Hadoop: The Basics

This session assumes absolutely no knowledge of Apache Hadoop and will provide a complete introduction to all the major aspects of the Hadoop ecosystem of projects and tools. If you are looking to get up to speed on Hadoop, trying to work out what all the Big Data...

Evolution as a Cybersecurity Strategy

Albert Einstein was quoted as saying, “Look deep into nature, and then you will understand everything better.” People describe the Internet as a hostile network — which is true — and that got me thinking about other hostile environments where a successful strategy...

HBase: 5 tips for running on low memory EC2

When running on EC2, you often can't win when it comes to instance types. One of the more cost-effective types available is the c1.xlarge. It has enough CPU to handle compactions, a decent amount of disk, and high network I/O. However, we've found that the relatively...

Big Data Wants to be Your Shopping Buddy

Imagine a nice Friday afternoon walking around your local mall. You walk into your favorite browsing for a new outfit to wear to your friend's party later in the evening. Although you usually shop in-store, sometimes you shop online, as many people all over the world...

Relational Vs Non-Relational databases – Part 1

In this post, we have seen some of the Big data technologies that are used to store and analyse data. For the past few years NoSQL or Non-relational database tools have gained much popular in terms of storing huge amount of data and scaling them easily. There are...

Fighting tax fraud with big data

John F. Kennedy famously said "It is a paradoxical truth that tax rates are too high today and tax revenues are too low," and with April 15 right around the corner, chances are your tax returns leave you hoping that everyone else is planning on paying their fair share...

Why you don’t need petabytes for a big data opening

Big data isn't necessarily big and can be as much about the complexities of processing information as about volumes or data types. Personal genetic-profiling services such as 23andMe, which charges $99 to sequence an individual's genome, illustrate the point,...

Why Your Analytics are Failing You

Many organizations investing millions in big data, analytics, and hiring quants appear frustrated. They undeniably have more and even better data. Their analysts and analytics are first-rate, too. But managers still seem to be having the same kinds of business...

Big Data Changed How We Measure Success

Who's No.1? How do you assess and define success? Who are the most popular artists and recordings at any given time? Ever since there has been a music industry, these questions have obsessed record company executives and artists alike. And to answer these questions,...

Top 4 big data challenges that universities face
Top 4 big data challenges that universities face

The rise of big data and big science have provided universities with an opportunity to work together on ways to technologically manage worldwide research projects. Misfolding proteins that cause Alzheimer's disease and the mysteries of dark matter and dark energy are...

Getting Serious about MySQL and Hadoop
Getting Serious about MySQL and Hadoop

Lean, mean MySQL and hulking Hadoop clusters may seem like an odd couple, but tying them together is now priority #1 for many MySQL users. This keynote talk on 1st day of this year's Percona Live MySQL Conference & Expo 2014 explores the data management trends...

This Hidden Big Data Play Beats Estimates
This Hidden Big Data Play Beats Estimates

Investors looking for a hot sector of IT spending should look no further than data analytics. IT companies like IBM (NYSE: IBM ) and Oracle (NYSE: ORCL ) managed to generate growth with their analytics solutions. In addition, there is also a burgeoning opportunity for...