Analytics & BI

Data Analytics,Big Data,Data Storage and Business Intelligence.

Subscribe

Install Big Data Tools (Spark, Zeppelin, Hadoop) in Windows for Learning and Practice

66 views   2 comments last modified about 2 months ago lite-log

Are you a Windows/.NET developer and willing to learn big data concepts and tools in your Windows? If yes, you can follow the links below to install them in your PC. The installations are usually easier to do in Linux/UNIX but they are not difficult to implement in Windows either since the...

View detail

Install Hadoop 3.0.0 in Windows (Single Node)

402 views   8 comments last modified about 2 months ago hadoop yarn hdfs

This page summarizes the steps to install Hadoop 3.0.0 in your Windows environment. Reference page: https://wiki.apache.org/hadoop/Hadoop2OnWindows ...

View detail

Install Teradata Express 15.0.0.8 by Using VMware Player 6.0 in Windows

11125 views   23 comments last modified about 4 years ago

In this article, I am going to introduce how to install Teradata Express in virtual machines in Windows. Download software 1) Download VMware Player for Windows 32-bit and 64-bit from the following link (version 6.0): ...

View detail

Write and Read Parquet Files in HDFS through Spark/Scala

36 views   0 comments last modified about 2 months ago lite-log spark hdfs scala parquet

In my previous post, I demonstrated how to write and read parquet files in Spark/Scala. The parquet file destination is a local folder. Write and Read Parquet Files in Spark/Scala In this page...

View detail

Write and Read Parquet Files in Spark/Scala

27 views   0 comments last modified about 2 months ago spark scala parquet

In this page, I’m going to demonstrate how to write and read parquet files in Spark/Scala by using Spark SQLContext class. Reference What is parquet format? Go the following project site to understand more about parquet. ...

View detail

Convert String to Date in Spark (Scala)

48 views   0 comments last modified about 2 months ago lite-log scala

Context This pages demonstrates how to convert string to java.util.Date in Spark via Scala. Prerequisites If you have not installed Spark, follow the page below to install it: ...

View detail

Read Text File from Hadoop in Zeppelin through Spark Context

65 views   0 comments last modified about 2 months ago zeppelin spark hadoop rdd

Background This page provides an example to load text file from HDFS through SparkContext in Zeppelin (sc). Reference The details about this method can be found at: SparkContext.textFile ...

View detail

Install Zeppelin 0.7.3 in Windows

177 views   0 comments last modified about 2 months ago zeppelin spark

This post summarizes the steps to install Zeppelin 0.7.3 in Windows environment. Tools and Environment GIT Bash Command Prompt Windows 10 Download Binary Package Download the latest binary package from the following website: ...

View detail

Use Hadoop File System Task in SSIS to Write File into HDFS

60 views   0 comments last modified about 2 months ago SSIS hadoop hdfs

Context SQL Server Integration Service ( SSIS ) has tasks to perform operations against Hadoop, for example: Hadoop File System Task Hadoop Hive Task Hadoop Pig Task In Data Flow Task, you can also use: Hadoop HDFS Source ...

View detail

Install Spark 2.2.1 in Windows

38 views   0 comments last modified about 2 months ago lite-log spark

This page summarizes the steps to install Spark 2.2.1 in your Windows environment. Tools and Environment GIT Bash Command Prompt Windows 10 Download Binary Package Download the latest binary from the following site: ...

View detail