Posts

Showing posts from March, 2020

Let's do some research on javafx

Some references found until start something on it. https://openjfx.io/ https://youtu.be/7Hai7cavmUY

Spark RnD

Image
The following stack of tools need to be configured once you downloaded and setup java 8 and Scala on your laptop. Remember to have a laptop with a higher RAM above 8 GB to set up this Big Data cluster on your machine. Configure Hadoop Configure Hbase Configure Kafka with Zookeeper Download Spark version which prebuilt with your hadoop version extract it and set %SPARK_HOME%\bin to Path variable create spark-env.cmd file in %SPARK_HOME%\conf folder Take the classpaths of your hadoop system by executing command on your windows command prompt [%HADOOP_HOME%\bin\hadoop classpath] copy the output and add that path to [set SPARK_DIST_CLASSPATH=] section of spark-env.cmd file Once you set with these all you are ready to execute spark-shell command