Kontext Project

Kontext is multi-user, cross-platform and full cloud based blog web application created by Raymond Tang using .NET Core 2.1. It utilizes VSTS as CI/CD tools and Azure as hosting environments.

Learn more

Mount Windows Shared Folder in SUSE or other Linux VMware Guest

13 views   0 comments last modified about 17 days ago lite-log linux

This page summarizes the steps to mount a windows shared folder in a Linux VMware guest machine, i.e. SUSE. Setup shared folder In Virtual Machine Settings windows, add shared folder. ...

View detail

Calculate Time Difference between Dates in PowerShell

13 views   0 comments last modified about 25 days ago lite-log powershell

PowerShell provides a number of cmdlets to retrieve current date time and to create time span object. Calculate time difference - CmdLets $current = Get-Date $end= Get-Date $diff= New-TimeSpan -Start $current -End $end Write-Output "Time difference is: $di...

View detail

Install Big Data Tools (Spark, Zeppelin, Hadoop) in Windows for Learning and Practice

66 views   2 comments last modified about 2 months ago lite-log

Are you a Windows/.NET developer and willing to learn big data concepts and tools in your Windows? If yes, you can follow the links below to install them in your PC. The installations are usually easier to do in Linux/UNIX but they are not difficult to implement in Windows either since the...

View detail

Write and Read Parquet Files in HDFS through Spark/Scala

35 views   0 comments last modified about 2 months ago lite-log spark hdfs scala parquet

In my previous post, I demonstrated how to write and read parquet files in Spark/Scala. The parquet file destination is a local folder. Write and Read Parquet Files in Spark/Scala In this page...

View detail

Write and Read Parquet Files in Spark/Scala

27 views   0 comments last modified about 2 months ago spark scala parquet

In this page, I’m going to demonstrate how to write and read parquet files in Spark/Scala by using Spark SQLContext class. Reference What is parquet format? Go the following project site to understand more about parquet. ...

View detail

Convert String to Date in Spark (Scala)

48 views   0 comments last modified about 2 months ago lite-log scala

Context This pages demonstrates how to convert string to java.util.Date in Spark via Scala. Prerequisites If you have not installed Spark, follow the page below to install it: ...

View detail

Tuples in C# (4.x, 7.0, 7.1)

33 views   0 comments last modified about 2 months ago C#

What is a tuple? Tuple is an ordered sequence, fixed-size, immutable and of heterogeneous objects. Tuple has been existing in other languages such as F#, Python, Perl and etc. for a long time. It was first introduced into C# from C# 4.0 and has been evolving over time. Since C# 7.1, tuple...

View detail

Read Text File from Hadoop in Zeppelin through Spark Context

65 views   0 comments last modified about 2 months ago zeppelin spark hadoop rdd

Background This page provides an example to load text file from HDFS through SparkContext in Zeppelin (sc). Reference The details about this method can be found at: SparkContext.textFile ...

View detail

Install Zeppelin 0.7.3 in Windows

177 views   0 comments last modified about 2 months ago zeppelin spark

This post summarizes the steps to install Zeppelin 0.7.3 in Windows environment. Tools and Environment GIT Bash Command Prompt Windows 10 Download Binary Package Download the latest binary package from the following website: ...

View detail

AspNetCore.XmlRpc 1.0.0-alpha.6 is ready

20 views   0 comments last modified about 2 months ago xml-rpc lite-log

Release date 2018-03-03 Changes Added PostId (attribute postid in MetaWeblog) into the predefined data model for PostInfo. public class PostInfo      {          [DataMember(Name = "title")] ...

View detail

Invoke Hadoop WebHDFS APIs in .NET Core

35 views   0 comments last modified about 2 months ago lite-log hadoop hdfs

Background Apache doesn't provide native official .NET APIs for Hadoop HDFS. The HTTP REST API supports the complete FileSystem / ...

View detail

Install Hadoop 3.0.0 in Windows (Single Node)

402 views   8 comments last modified about 2 months ago hadoop yarn hdfs

This page summarizes the steps to install Hadoop 3.0.0 in your Windows environment. Reference page: https://wiki.apache.org/hadoop/Hadoop2OnWindows ...

View detail

Use Hadoop File System Task in SSIS to Write File into HDFS

60 views   0 comments last modified about 2 months ago SSIS hadoop hdfs

Context SQL Server Integration Service ( SSIS ) has tasks to perform operations against Hadoop, for example: Hadoop File System Task Hadoop Hive Task Hadoop Pig Task In Data Flow Task, you can also use: Hadoop HDFS Source ...

View detail

Install Spark 2.2.1 in Windows

38 views   0 comments last modified about 2 months ago lite-log spark

This page summarizes the steps to install Spark 2.2.1 in your Windows environment. Tools and Environment GIT Bash Command Prompt Windows 10 Download Binary Package Download the latest binary from the following site: ...

View detail

C# version history and core features

49 views   0 comments last modified about 2 months ago C# lite-log

C# is my favourite programming language and has been evolving overtime. I have been programming with many other languages but C# is always my favourite because it is simple and easy to use. Visual Studio is the most powerful tool I’ve ever used. To me, programming efficiency and peformance are th...

View detail

Kontext Release 3.0.0.0-alpha.4

32 views   0 comments last modified about 2 months ago kontext

Kontext 3.0.0.0 alpha 4 is now released. This is a major release with complete code-rewritten. The whole project is now fully managed in VSTS for continuous integration and deployment. It will be updated in an Agile manner. Every code commit will trigger VSTS build plan followed by deployment int...

View detail

Querying Teradata and SQL Server - Tutorial 1: The SELECT Statement

27179 views   7 comments last modified about 3 years ago

SELECT is one of the most commonly used statements. In this tutorial, I will cover the following items: Two of the principal query clauses—FROM and SELECT Data Types Built-in functions CASE expressions and variations like ISNULL and COALESCE. * The functio...

View detail

Install Teradata Express 15.0.0.8 by Using VMware Player 6.0 in Windows

11125 views   23 comments last modified about 4 years ago

In this article, I am going to introduce how to install Teradata Express in virtual machines in Windows. Download software 1) Download VMware Player for Windows 32-bit and 64-bit from the following link (version 6.0): ...

View detail

Working with SQL Server Compact 4.0 using Entity Framework 6 and ADO.NET

9886 views   0 comments last modified about 4 years ago

SQL Server Compact 4.0 (CE 4.0) is a free SQL Server embedded database ideal for building standalone and occasionally connected applications for mobile devices, desktops, Web clients and others. In one of my projects, I used it as the database for logging errors, which assumes the errors will onl...

View detail

Generate Formatted Excel Destination (Output) in SSIS Data Flow Task

7715 views   0 comments last modified about 4 years ago

SSIS (SQL Server Integration Service) provides a number of convenient tasks to enable data integration. Exporting data from database to Excel file is a common task in ETL (Extract, Transform, Load) projects. Constantly the users/customers may raise format request regarding the Excel extract. To g...

View detail

Create ETL Project with Teradata through SSIS

7315 views   2 comments last modified about 3 years ago

Infosphere DataStage is adopted as ETL (Extract, Transform, Load) tool in many Teradata based data warehousing projects. With the Teradata ODBC and .NET data providers, you can also use the BI tools from Microsoft, i.e. SSIS. In my previous post, I demonstrated how to install Teradata Tool...

View detail

Connect to Teradata Virtual Machine Guest from Windows Host

5065 views   16 comments last modified about 3 years ago

In my previous posts about Querying Teradata and SQL Server, I logged into the virtual machine graphic interface to manage the database. However, I constantly found it is resource intensive as there is only 4GB memory in my laptop. Instead, I will use text mode to start the virtual machine and co...

View detail

Issue - Unable to get property 'apply' of undefined or null reference occurred in Angular 4.*, VS2017 15.3, ASP.NET Core 2.0

4923 views   10 comments last modified about 12 months ago dotnet core angular asp.net core 2

Issue Context After installed Visual Studio 2017 15.3 preview and .net core 2.0 preview SDK, I upgraded one of my existing asp.net core project to 2.0. The project was created using ‘dotnet new angular’ SPA template.  I also upgraded all the client app packages to the latest. For exa...

View detail

Java Kerberos Authentication Configuration Sample & SQL Server Connection Practice

3890 views   2 comments last modified about 2 years ago Java kerberos

Overview Recently, I have been working on an ETL framework to load various source data (i.e. files, SQL Server, Oracle and Teradata) into Teradata. Due to some limitations, Java was chosen as the implementation language though IBM Infosphere DataStage is available to use. DataStage has p...

View detail

[C#] Connect to Teradata Database via .NET Data Provider

3721 views   2 comments last modified about 3 years ago

In this post, I will demonstrate how to connect to Teradata database via .NET Data Provider for Teradata using C#. Prerequisites Install the .NET Data Provider for Teradata from the following link: ...

View detail

Resolve the Issues in Upgrading Entity Framework to Version 6.1

3510 views   0 comments last modified about 4 years ago

When upgrading your Entity Framework to Entity Framework 6.1 (EF6) from version 5.0, you may meet a number of issues. I have summarized all the issues I’ve encountered and their resolutions for your reference. Upgrade to EF6 Microsoft has provided one summary about upgrading to E...

View detail

Create and Debug C/C++ Programs with Eclipse and Cygwin in Windows

2807 views   0 comments last modified about 3 years ago

In this post, I am going to demonstrate how to use Eclipse to create and debug C/C++ programs for Unix/Linux in Windows. I am going to use Cygwin GCC as toolchains. Cygwin GDB will also be installed for debugging purpose. I am using Windows 10 and JRE 1.8 in the following steps. Install E...

View detail

Querying Teradata and SQL Server - Tutorial 2 Filtering and Sorting

2681 views   2 comments last modified about 3 years ago

Tutorial –1 For Teradata developers, if you have no SQL Server installed, please go to the following link to download the SQL Server 2014 Expression Edition. ...

View detail

Querying Teradata and SQL Server - Tutorial 0: Preparation

2464 views   0 comments last modified about 3 years ago

In this serial, I will compare Teradata SQL with T-SQL with samples provided. This is mainly prepared for SQL Server DBAs, Developers and other users to help them quickly master the common used SQLs in Teradata platform. Similar to T-SQL, Teradata SQL implements most part of the ANSI SQL with ext...

View detail

Surface RT/Pro 版本Windows 8 QQ下载与安装

2375 views   0 comments last modified about 5 years ago

Surface的用户可能会遇到一个难题,在应用商城里边无法搜索到QQ应用程序。但是让我疑惑的是,我的Windows 8.1 系统之前是成功安装了QQ。

后来在腾讯QQ下载官网发现,其实是有QQ应用安装的链接:

按照如下方法安装Surface QQ.

Have fun!

image

View detail

Server.MapPath Equivalent in ASP.NET Core 2

2221 views   0 comments last modified about 7 months ago asp.net core 2

In traditional asp.net applications, Server.MapPath is commonly used to generate absolute path in the web server. However, this has been removed from ASP.NET Core. So what is the equivalent way of doing it?

View detail

Migrate from Universal Membership Provider to ASP.NET Identity 2.1.0 - PasswordHarsher

2084 views   2 comments last modified about 4 years ago

In my previous post, I demonstrated how to migrate from ASP.NET Universal Membership Provider to ASP.NET Identity 2.1.0. ...

View detail

Raymond Tang about 29 days ago

@Neil S

No need to apology. I don't have one VM with Windows 7 so I could not verify for you.

I was about to suggest you to create one issue in the GitHub and then I just noticed you already did that.

https://github.com/steveloughran/winutils/issues/9 

Let's see how the author would response. 

The WinUtils project source code is available here:

https://github.com/apache/hadoop/tree/f67237cbe7bc48a1b9088e990800b37529f1db2a/hadoop-common-project/hadoop-common/src/main/winutils 

You may want to debug it in your system (if you have Visual Studio installed). More specifically, the source code for the command you are invoking is available here:

https://github.com/apache/hadoop/blob/f67237cbe7bc48a1b9088e990800b37529f1db2a/hadoop-common-project/hadoop-common/src/main/winutils/systeminfo.c

If I am using Windows 7, I could actually help you to debug.

Neil S about 29 days ago

@Raymond Tang

I have to apologize, I missed the point that you mentioned Windows 10 as the work environment at the begining of the tutorial, so the tutorial is not applied to Windows 7 64 bit.

I'm really sorry about my mistake.

Neil S about 29 days ago

@Raymond Tang

If you ran the command on Windows 10 and you didn't find any problems, then it doesn't contradict with what I wrote and the tutorial is relevant for Windows 10, but if the command "winutils systeminfo" returns the error when running on Windows7 64 bit then it may be beneficial noticing some requirenments in the tutorial that Hadoop 3.0.0 can only be installed on Windows 10 at the moment untill the issue with winutils.exe is not solved for Windows7 64 bit, due to the reason that winutils.exe for Hadoop 3.0.0 still doesn't on Windows7 64 bit.

Raymond Tang about 29 days ago

@Neil S

I have run the command in my system. I didn't get any issue.


Neil S about 29 days ago

@Raymond Tang

I followed all the steps to setup. The problem is played back on Windows7 64bit. If you try issuing a command "winutils systeminfo" in the directory where winutils.exe for Hadoop 3.0.0 is located you will receive an error responce. This does not happen if you do the same with winutils for hadoop 2.6.4 or 2.7.x for instance but unfortunately this version of the executable file is not suitable for Hadoop 3.0.

Raymond Tang about 30 days ago

@Neil S.

The machine I am using is Windows 10 64 bit and it is working properly all the time.

Did you follow all the steps to setup?

Neil S. about 30 days ago

Unfortunately the issue with the missing winutils.exe in the binary distributive of Hadoop 3.0.0 cannot be solved. The file windows.exe downloaded from the above mentioned mentioned resource causes an error when run with the parameter systeminfo on Windows7 64 bit. The text of the error is PdhAddCounter \Network Interface(*)\Bytes Received/Sec failed with 0xc0000bb8.
Error in GetDiskAndNetwork. Err:1

Raymond Tang about 2 months ago

@Raju

In which step you could not type password? In this tutorial, there are two places:

  • Logon to suse  (use Ctrl +Alt to release mouse cursor, for more details about VMware shortcuts, refer to this page)
  • Connect to Teradata database in Teradata Studio Express.

Raju about 2 months ago

i installed teradata in vmware player.but i am unable to type password. it is not taking input to password.please anyone help me.where am going wrong.

Raymond about 3 months ago

Version 3.0 beta1 is now available. 

Raymond about 4 months ago

@Matt

If you followed all the steps, in the UNIX virtual machine, Teradata Studio Express is already included. You can use that tool to connect to the Teradata server using dbc account and then create any database you like.

Alternatively, please follow the link below to setup client tools in your Windows (host machine for the Teradata VM), which will enable you to connect directly:

http://kosmisch.net/Blog/DataAndBusinessIntelligence/Archive/2015/5/18/connect-to-teradata-virtual-machine-guest-from-windows-host.html 

You can use Teradata Administrator client tool if you are not familiar with SQL.

Matt about 4 months ago

@Matt I simply don't have the Create Data base in the Tools. I am very new to Teradata.