Difference between spark, storm, samza and flink tools

Hi Readers,

In this post, I have consolidated the various features difference between spark, storm, samza and flink tools.

apachesparkdiff

You can also bookmark this page for future reference.

You can share this page with your friends.

Follow me Jose Praveen for future notifications.

My quora answers on big data, data science, blockchain, bitcoin, windows 10/ 8/ 7, linux, j2EE and much more

Hi Readers,

I used to write answers for the tech questions which are asked in quora.com. In this post  you can read all my answer for various topics like big data, data science, blockchain, bitcoin, windows 10/ 8/ 7, linux, j2EE etc.

Big Data, Data Science Problems and Solutions

https://hadoopexamples.quora.com/Big-Data-Data-Science-Problems-and-Solutions

Java, J2EE Problems and Solutions

https://javastackexamples.quora.com/Java-J2EE-Problems-and-Solutions

Windows 10/ 8/ 7, OS, Memory issues, Linux, VM Problems and Solutions

https://issuesfixed.quora.com/Windows-10-8-7-OS-Memory-issues-Linux-VM-Problems-and-Solutions

Blockchain, Bitcoin Problems and Solutions

https://blockchainlearning.quora.com/Blockchain-Bitcoin-Problems-and-Solutions

#askmequestions #quora

 

You can also bookmark this page for future reference.

You can share this page with your friends.

Follow me Jose Praveen for future notifications.

Get Blockchain statistics details using python and automate it.

Hi Readers,

In this post you will be learning how to get blockchain statistics using python and automate it. I used ‘statistics’ module for explanation.

I have just written a simple python program to get current bitcoin trade volume, number of bitcoin mined till now, number of transactions etc.

You can use the above script to self-automate send email, use twilio service to sms etc.

The below scripts helps you to send email about bitcoin statistics like bitcoin trade volume, number of bitcoin mined till now, number of transactions etc. You can also use cron job to schedule so that the script can run at particular interval.

Error initializing SparkContext : ‘sparkDriver’ failed after 16 retries!

Hi All,

I just came across this error ‘sparkDriver’ failed after 16 retries!’ while starting the spark shell.

spark-scala

From the above screenshot, I came to know the error occurred due to the SparkUI port was not available. For this scenario I used Cloudera sandbox using Oracle VirtualBox.

I just solved this issue by the following steps

  1. Go to /usr/lib/spark/bin (path for cloudera sandbox)
  2. Open load-spark-env.sh and add this export SPARK_LOCAL_IP=’127.0.0.1′ (you need to be root user)
  3. Save the file and type ‘spark-shell’ to get sparkcontext initialized

Thanks for reading this post. Subscribe my blog for  some awesome posts.

Solve for India – Chennai

Hi Readers,

Today, I went to solve for India workshop conducted by GDG India. The workshop started with Welcome Note from GDG speakers and continued with sessions like designing for Indian Users target 2020, building for billion framework, kubernetes, firebase, GCP console and a 45 minutes open house session.

#SolveForIndia

Machine Learning Roadshow – Chennai

Hi Readers,

Today, I have attended Machine Learning workshop conducted by Google. It was a full day tech session. Morning session covered machine learning basics, use cases explained, tensorflow 101 and afternoon session covered with machine learning & tensorflow code labs (hands-on in real GCP environment).

#MLRoadshowIndia