Hi Readers, I am happy to share that I have just crossed 1 million answer views in quora.com on 12/12/2017. I used to write answer for question which are asked by fellow quorains. Mostly I write answer for topics like windows, OS, java, big data, spring boot etc. Just passed 1 million answer views on […]
I just came across this error ‘sparkDriver’ failed after 16 retries!’ while starting the spark shell.
From the above screenshot, I came to know the error occurred due to the SparkUI port was not available. For this scenario I used Cloudera sandbox using Oracle VirtualBox.
I just solved this issue by the following steps
- Go to /usr/lib/spark/bin (path for cloudera sandbox)
- Open load-spark-env.sh and add this export SPARK_LOCAL_IP=’127.0.0.1′ (you need to be root user)
- Save the file and type ‘spark-shell’ to get sparkcontext initialized
Thanks for reading this post. Subscribe my blog for some awesome posts.
Today, I went to solve for India workshop conducted by GDG India. The workshop started with Welcome Note from GDG speakers and continued with sessions like designing for Indian Users target 2020, building for billion framework, kubernetes, firebase, GCP console and a 45 minutes open house session.
Today, I have attended Machine Learning workshop conducted by Google. It was a full day tech session. Morning session covered machine learning basics, use cases explained, tensorflow 101 and afternoon session covered with machine learning & tensorflow code labs (hands-on in real GCP environment).