Tag - lite-log

Install Big Data Tools (Spark, Zeppelin, Hadoop) in Windows for Learning and Practice

66 views   2 comments last modified about 2 months ago lite-log

Are you a Windows/.NET developer and willing to learn big data concepts and tools in your Windows? If yes, you can follow the links below to install them in your PC. The installations are usually easier to do in Linux/UNIX but they are not difficult to implement in Windows either since the...

View detail

Mount Windows Shared Folder in SUSE or other Linux VMware Guest

13 views   0 comments last modified about 17 days ago lite-log

This page summarizes the steps to mount a windows shared folder in a Linux VMware guest machine, i.e. SUSE. Setup shared folder In Virtual Machine Settings windows, add shared folder. ...

View detail

Calculate Time Difference between Dates in PowerShell

13 views   0 comments last modified about 25 days ago lite-log

PowerShell provides a number of cmdlets to retrieve current date time and to create time span object. Calculate time difference - CmdLets $current = Get-Date $end= Get-Date $diff= New-TimeSpan -Start $current -End $end Write-Output "Time difference is: $di...

View detail

Write and Read Parquet Files in HDFS through Spark/Scala

36 views   0 comments last modified about 2 months ago lite-log

In my previous post, I demonstrated how to write and read parquet files in Spark/Scala. The parquet file destination is a local folder. Write and Read Parquet Files in Spark/Scala In this page...

View detail

Convert String to Date in Spark (Scala)

48 views   0 comments last modified about 2 months ago lite-log

Context This pages demonstrates how to convert string to java.util.Date in Spark via Scala. Prerequisites If you have not installed Spark, follow the page below to install it: ...

View detail

AspNetCore.XmlRpc 1.0.0-alpha.6 is ready

20 views   0 comments last modified about 2 months ago lite-log

Release date 2018-03-03 Changes Added PostId (attribute postid in MetaWeblog) into the predefined data model for PostInfo. public class PostInfo      {          [DataMember(Name = "title")] ...

View detail

Install Spark 2.2.1 in Windows

38 views   0 comments last modified about 2 months ago lite-log

This page summarizes the steps to install Spark 2.2.1 in your Windows environment. Tools and Environment GIT Bash Command Prompt Windows 10 Download Binary Package Download the latest binary from the following site: ...

View detail

C# version history and core features

49 views   0 comments last modified about 2 months ago lite-log

C# is my favourite programming language and has been evolving overtime. I have been programming with many other languages but C# is always my favourite because it is simple and easy to use. Visual Studio is the most powerful tool I’ve ever used. To me, programming efficiency and peformance are th...

View detail

Invoke Hadoop WebHDFS APIs in .NET Core

35 views   0 comments last modified about 2 months ago lite-log

Background Apache doesn't provide native official .NET APIs for Hadoop HDFS. The HTTP REST API supports the complete FileSystem / ...

View detail

Hadoop datanode issue and resolution - ‘Incompatible clusterIDs’

13 views   0 comments last modified about 3 months ago lite-log

Issue After finishing installation Hadoop 3.0.0 in my Windows: Install Hadoop 3.0.0 in Windows (Single Node) , I got the following error after I formated the name node several tim...

View detail