Azure Data Platforms
Following are different data platforms available as of now in Microsoft Azure. Azure Storage Azure Storage is the cloud storage solution…
Exploring Azure Data Lake Store Preview
The Azure Data Lake Store is a cloud repository where you can easily store data of any size or any…
Enterprise Data Lake – Azure Way!
What is an Enterprise Data Lake? Way back in 2010, Pentaho co-founder and CTO, James Dixon coined the term ‘Data…
Apache Spark – Big Data Platform for All
Apache Spark is a powerful open source in-memory cluster computing framework built around speed, ease of use, and sophisticated analytics.…
Using IPython and Visual Studio with Apache Spark
To develop Apache Spark applications in IPython and Python tools for Visual Studio we need to set the environment variables…
File operations in HDFS using java
I am using HDP for windows (1.3.0.0) single node and Eclipse as development environment. Below are few samples to read…
Quick notes on YARN (Hadoop 2.0)
Problems we had before YARN: JobTracker is solely responsible for handling resources and tasks progress. Scalability Limitation: Maximum cluster size…