A Simple Apache Spark Demo

Apache Spark is a data processing framework that can quickly perform processing tasks on very large data sets, and can also distribute data processing tasks across multiple computers, either on its own or in tandem with other distributed computing tools

About this example

In this post I am sharing a simple Apache Spark example project. The source code used for this example is available here: https://github.com/jobinesh/apache-spark-examples.git

Here is the quick overview of the modules that you may find in this project

  • spark-job-common :  All common classes that you need for building a Spark job are parked here. This approach may help you to avoid boilerplate code in your Spark job implementation
  • spark-job-impl : A classic word count Spark  example is available here.   This class may help you to understand the structuring of the source and usage of common classes from spark-job-common module
  • spark-job-launcher : The SparkLauncher helps you to start Spark applications programmatically.

The Spark application that you may find in the spark-job-impl module reads the text from src/main/resources/demo.txt file
and generates an output file with total count for each word. 
The output directory location is configured in src/main/resources/application.conf

How to run this example?

The detailed steps are available here: 

Enjoy !
   

Comments

  1. Thank you, this blog is awesome and super. I really love your article. Thanks once again,
    Germany VPS Server

    ReplyDelete
  2. I will truly value the essayist's decision for picking this magnificent article fitting to my matter.Here is profound depiction about the article matter which helped me more.
    data science courses in malaysia

    ReplyDelete
  3. Great blog!! I hope you'll post a Data Science blog here.
    data science course in delhi

    ReplyDelete
  4. Hello there to everyone, here everybody is sharing such information, so it's fussy to see this webpage, and I used to visit this blog day by day
    hrdf training course

    ReplyDelete
  5. You re in motivation behind fact an on-target site administrator. The site stacking speed is amazing. It kind of feels that you're doing a specific trick. What's more, The substance is a masterpiece. you have done a marvelous development concerning this issue!
    360DigiTMG

    ReplyDelete
  6. I was looking at a portion of your posts on this site and I consider this site is really enlightening! Keep setting up..
    https://360digitmg.com/course/certification-program-on-big-data-with-hadoop-spark

    ReplyDelete
  7. I'm glad to see the extensive unpretentious component here!.
    what is hrdf claimable

    ReplyDelete
  8. The information you have posted is important. The objections you have insinuated was worthy. Thankful for sharing.
    digital marketing courses in malaysia

    ReplyDelete
  9. This is a great inspiring article.I am pretty much pleased with your good work.You put really very helpful information...
    data science training

    ReplyDelete
  10. While most arrangements at second hand shops are very acceptable contrasted with retail, periodically somebody doing the estimating will put a label that is substantially a lot for a thing.besimple.com/

    ReplyDelete
  11. I was looking at a portion of your posts on this site and I consider this site is really enlightening! Keep setting up..
    HRDF Claimable

    ReplyDelete
  12. "I can set up my original thought from this post. It gives all around data. A commitment of gratefulness is all together for this essential data for all,

    "
    training provider in malaysia

    ReplyDelete
  13. Thank you for your post, I look for such article along time, today i find it finally. this post give me lots of advise it is very useful for me !data science training in Hyderabad

    ReplyDelete

  14. keep up the good work. this is an Ossam post. This is to helpful, i have read here all post. i am impressed. thank you. this is our site please visit to know more information
    data science courses

    ReplyDelete
  15. Excellent post. I was always checking this blog, and I’m impressed! Extremely useful info specially the last part, I care for such information a lot. I was exploring this particular info for a long time. Thanks to this blog my exploration has ended.
    If you want Digital Marketing Serives :-
    Digital marketing Service in Delhi
    SMM Services
    PPC Services in Delhi
    Website Design & Development Packages
    SEO Services PackagesLocal SEO services
    E-mail marketing services
    YouTube plans

    ReplyDelete
  16. Thanks for posting this info. I just want to let you know that I just check out your site and I find it very interesting and informative. I can't wait to read lots of your posts.
    Digital Marketing Training Institutes in Hyderabad

    ReplyDelete
  17. I’ve been searching for some decent stuff on the subject and haven't had any luck up until this point, You just got a new biggest fan!..
    business analytics course

    ReplyDelete
  18. Incredibly conventional blog and articles. I am realy very happy to visit your blog. Directly I am found which I truly need. Thankful to you and keeping it together for your new post.
    data science certification malaysia

    ReplyDelete
  19. And if so be the case then, demand for people with strong programming skills will definitely rise with more number of people required to develop and support the applications. data science course in india

    ReplyDelete
  20. Nice Blog !
    Need quick help in QuickBooks? Don’t get annoyed!! Just reach out to our QuickBooks Phone Number 1-855-652-7978, and acquire excellent service benefits. We have a technical team of QB experts who can troubleshoot all sorts of complicated error codes without taking too much time

    ReplyDelete
  21. Great blog!! I hope you'll post a Data Science blog here. hair transplant turkey success rate

    ReplyDelete
  22. This article content is really unique and amazing. This article really helpful and explained very well's i am really thankful to you for sharing keep it up..

    Digital Marketing Service in Kanpur

    ReplyDelete
  23. Really glad to say, your post is very interesting to read. I never stop myself to say anything about it. You are doing a great job. Thank you for sharing this blog here
    Singapore Online Job Vacancy 2021

    ReplyDelete
  24. Incredibly conventional blog and articles. I am realy very happy to visit your blog. Directly I am found which I truly need. Thankful to you and keeping it together for your new post.
    data science courses in gurgaon

    ReplyDelete
  25. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.
    Data Science Course in Bangalore

    ReplyDelete
  26. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.
    Data Science Course in Bangalore

    ReplyDelete
  27. This article's content is really unique and amazing. This article really helpful and explained very well. So I am really thankful to you for sharing keep it up..

    หวยออนไลน์จ่ายจริง

    ReplyDelete
  28. I just got to this amazing site not long ago. I was actually captured with the piece of resources you have got here. Big thumbs up for making such wonderful blog page!
    data analytics course in bangalore

    ReplyDelete
  29. Set aside me effort to see the entirety of the remarks, yet I genuinely appreciated the review. It demonstrated being truly useful to me and Im positive to the entirety of the analysts here! Its continually pleasant when you can not exclusively be educated, yet in addition engaged! I am sure you had pleasant composing this review.
    data scientists training

    ReplyDelete
  30. Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!
    Data Science Training in Bangalore

    ReplyDelete
  31. Amazing Article. I would also suggest for Data Science course with Real time experience, visit: https://socialprachar.com/data-science-training-in-bengaluru/

    ReplyDelete
  32. I am really enjoying reading your well written articles. It looks like you spend a lot of effort and time on your blog. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work.
    artificial intelligence course in pune

    ReplyDelete
  33. I am really enjoying reading your well written articles. It looks like you spend a lot of effort and time on your blog. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work.
    artificial intelligence course in pune

    ReplyDelete
  34. I am a new user of this site, so here I saw several articles and posts published on this site, I am more interested in some of them, hope you will provide more information on these topics in your next articles.
    data analytics training in bangalore

    ReplyDelete
  35. I just got to this amazing site not long ago. I was actually captured with the piece of resources you have got here. Big thumbs up for making such wonderful blog page!
    data analytics course in bangalore

    ReplyDelete
  36. This is excellent information about the job which is shared by you. This information is meaningful and magnificent for us to increase our knowledge about it. Keep sharing this kind of information. Thank you. Jobs in Luton

    ReplyDelete
  37. Very awesome!!! When I searched for this I found this website at the top of all blogs in search engines.

    business analytics course

    ReplyDelete
  38. I am glad to discover this page. I have to thank you for the time I spent on this especially great reading !! I really liked each part and also bookmarked you for new information on your site.
    Data Science Training in Chennai

    ReplyDelete
  39. Thanks for sharing A Simple Apache Spark Demo. That is very useful to me as Immigration Consultants Singapore

    ReplyDelete


  40. Really impressed! Everything is very open and very clear clarification of issues. It contains true facts. Your website is very valuable. Thanks for sharing.

    Data Science Training in Hyderabad

    ReplyDelete
  41. Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!
    Data Science Training in Bangalore

    ReplyDelete
  42. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    data science training in bangalore

    ReplyDelete
  43. I just got to this amazing site not long ago. I was actually captured with the piece of resources you have got here. Big thumbs up for making such wonderful blog page!
    artificial intelligence course in pune

    ReplyDelete
  44. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors.
    data analytics course in bangalore

    ReplyDelete
  45. I Want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging endeavors.
    data science in bangalore

    ReplyDelete
  46. It's really nice and meaningful. it's a really cool blog. Linking is a very useful thing.you have really helped lots of people who visit blogs and provide them useful information.

    Data Science Training

    ReplyDelete
  47. I just got to this amazing site not long ago. I was actually captured with the piece of resources you have got here. Big thumbs up for making such wonderful blog page!
    artificial intelligence course in pune

    ReplyDelete
  48. This article is exciting. I am pleased to read it. If you wonder what every type of papers should look like, visit https://primeessays.com/samples/world-literature/the-necklace-by-guy-de-maupassant.html There are hundreds of free samples pf essays.

    ReplyDelete
  49. I must appreciate you for providing such valuable content for us. To make our dreams a reality, everyone has to put up a hard struggle in their life. Here I am making my small effort to arrange up the list of highest paying Jobs in India. We provide one of the best courses for you.
    1) Data Science course in Delhi
    2) Artificial Intelligence Course in Delhi
    3) Machine Learning course in Delhi
    4) Business Analytics courses in Delhi
    5) Digital marketing course in Delhi
    6) Full Stack Software Developer course in Delhi.

    ReplyDelete
  50. I am glad to discover this page. I have to thank you for the time I spent on this especially great reading !! I really liked each part and also bookmarked you for new information on your site.
    Data Science Training in Chennai

    ReplyDelete
  51. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors.
    data analytics course in bangalore

    ReplyDelete

  52. Very awesome!!! When I searched for this I found this website at the top of all blogs in search engines.

    Data Science Training

    ReplyDelete
  53. Thanks for sharing this informative content, Great work.

    To crack Scrum master interview: Scrum master interview questions

    ReplyDelete
  54. Your blog is very valuable which you have shared here about JOBS I appreciate your efforts which you have put into this article and also it is a gainful article for us. Thank you for sharing this article here. Careers working with developmental disabilities

    ReplyDelete
  55. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors.
    data science course fees in bangalore

    ReplyDelete
  56. I read your article and after I read got beneficial information about the jobs. Your article contains excellent information and knowledge. It is beneficial for all. .Jobs in BC CanadaKeep sharing.

    ReplyDelete
  57. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors.
    data science course fees in bangalore

    ReplyDelete
  58. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors.
    data analytics courses in bangalore

    ReplyDelete
  59. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    cyber security training in bangalore

    ReplyDelete
  60. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    cyber security training in bangalore

    ReplyDelete
  61. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors.
    data analytics courses in bangalore

    ReplyDelete
  62. I am glad to discover this page. I have to thank you for the time I spent on this especially great reading !! I really liked each part and also bookmarked you for new information on your site.
    Data Science Training in Chennai

    ReplyDelete
  63. Highly appreciable regarding the uniqueness of the content. This perhaps makes the readers feels excited to get stick to the subject. Certainly, the learners would thank the blogger to come up with the innovative content which keeps the readers to be up to date to stand by the competition. Once again nice blog keep it up and keep sharing the content as always.

    data analytics courses in bangalore with placement

    ReplyDelete
  64. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    cyber security training in bangalore

    ReplyDelete
  65. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.
    Data Science Course in Bangalore

    ReplyDelete
  66. Thanks for posting the best information and the blog is very helpful.digital marketing institute in hyderabad

    ReplyDelete
  67. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.
    Data Science Course in Bangalore

    ReplyDelete
  68. This post is very simple to read and appreciate without leaving any details out. Great work!
    data science training in pune

    ReplyDelete
  69. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    cyber security training in bangalore

    ReplyDelete
  70. Thanks for posting the best information and the blog is very important.data science institutes in hyderabad

    ReplyDelete
  71. The information you have posted is very useful. The sites you have referred to were good. Thanks for sharing.
    data scientist training and placement in hyderabad

    ReplyDelete
  72. I have expressed a few of the articles on your website now, and I really like your style of blogging. I added it to my favorite’s blog site list and will be checking back soon…

    best data science institute in hyderabad

    ReplyDelete
  73. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.
    Data Science Course in Bangalore

    ReplyDelete
  74. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    cyber security training in bangalore

    ReplyDelete
  75. I just got to this amazing site not long ago. I was actually captured with the piece of resources you have got here. Big thumbs up for making such wonderful blog page!
    data analytics course in bangalore

    ReplyDelete
  76. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors.
    data science course

    ReplyDelete
  77. This is an excellent post . thanks for sharing it. It is really what I wanted to see. I hope in the future you will continue to share such an excellent post.

    business analytics course

    ReplyDelete
  78. Download Cricket Mazza 11 for Android Live Line & Fastest IPL Score. Get Live Cricket Scores, Scorecard, Commentary, Match Info and Schedules of All International & Domestic Matches, Series wise Stats, Records, Analysis and Facts, Trending News and Tweets, Recent ICC Player and Team Rankings. Also Download best cricket game apps for ios, including Beach Cricket, Cricket T20 Fever 3D, Download Real Cricket mazza 11 and other top answers suggested and ranked.

    ReplyDelete
  79. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    data science course

    ReplyDelete
  80. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors.
    data science course in chennai

    ReplyDelete
  81. Thanks for posting the best information and the blog is very important.artificial intelligence course in hyderabad

    ReplyDelete
  82. I am glad to discover this page. I have to thank you for the time I spent on this especially great reading !! I really liked each part and also bookmarked you for new information on your site.
    Data Science Training in Chennai

    ReplyDelete
  83. I am a new user of this site, so here I saw several articles and posts published on this site, I am more interested in some of them, hope you will provide more information on these topics in your next articles.
    data analytics training in bangalore

    ReplyDelete
  84. Your text was very informative for me but I'd like to add that in terms of the set of components and functionality, Spark can be compared with another Big Data distributed stream processing tool - Apache Flink. By the way if you need to pass paper works I would like to recommend very good service where you can buy pre written essays on any topic and subject!

    ReplyDelete
  85. I feel very grateful that I read this. It is very helpful and very informative and I really learned a lot from it.
    business analytics course


    ReplyDelete
  86. I see some amazingly important and kept up to a length of your strength searching for in your on the site
    Best Data Science courses in Hyderabad

    ReplyDelete
  87. I read that Post and got it fine and informative. Please share more like that...
    Best Data Science courses in Hyderabad

    ReplyDelete
  88. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.
    Data Science Course in Bangalore

    ReplyDelete
  89. I want to leave a little comment to support and wish you the best of luck.we wish you the best of luck in all your blogging enedevors.
    data science course in chennai

    ReplyDelete
  90. https://360digitmg.com/india/data-science-using-python-and-r-programming-bangalore
    Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!
    Data Science Training in Bangalore

    ReplyDelete
  91. I feel very grateful that I read this. It is very helpful and very informative and I really learned a lot from it.
    best data science institute in hyderabad

    ReplyDelete
  92. I am glad to discover this page. I have to thank you for the time I spent on this especially great reading !! I really liked each part and also bookmarked you for new information on your site.
    artificial intellingence training in chennai

    ReplyDelete
  93. Thanks for posting the best information and the blog is very important.data science institutes in hyderabad

    ReplyDelete
  94. Fantastic article I ought to say and thanks to the info. Instruction is absolutely a sticky topic. But remains one of the top issues of the time. I love your article and look forward to more.
    Data Science Course in Bangalore

    ReplyDelete
  95. Thank you quite much for discussing this type of helpful informative article. Will certainly stored and reevaluate your Website.
    Data Science certification Course in Bangalore

    ReplyDelete
  96. Nice to be seeing your site once again, it's been weeks for me. This article which ive been waited for so long. I need this guide to complete my mission inside the school, and it's same issue together along with your essay. Thanks, pleasant share.
    Data Science training in Bangalore

    ReplyDelete
  97. Truly mind blowing blog went amazed with the subject they have developed the content. These kind of posts really helpful to gain the knowledge of unknown things which surely triggers to motivate and learn the new innovative contents. Hope you deliver the similar successive contents forthcoming as well.

    Data Science in Bangalore

    ReplyDelete
  98. I am glad to discover this page. I have to thank you for the time I spent on this especially great reading !! I really liked each part and also bookmarked you for new information on your site.
    Data Science Course Syllabus

    ReplyDelete
  99. This comment has been removed by the author.

    ReplyDelete
  100. Very wonderful informative article. I appreciated looking at your article. Very wonderful reveal. I would like to twit this on my followers. Many thanks! .
    Data Science certification training in Bangalore

    ReplyDelete
  101. i am glad to discover this page : i have to thank you for the time i spent on this especially great reading !! i really liked each part and also bookmarked you for new information on your site.
    artificial intelligence training in chennai

    ReplyDelete
  102. Hi! Excellent blog which describes all the A Simple Apache Spark Demo of the blog in detail. If you want to know about server hosting or interested in best USA VPS Hosting you can ask us for more details and services. Get best and fast hosting service with us. Don't think get fastest hosting services with us. Buy one of the fastest and reliable hosting services

    ReplyDelete
  103. Thanks for posting the best information and the blog is very important.digital marketing institute in hyderabad

    ReplyDelete
  104. Thank you quite much for discussing this type of helpful informative article. Will certainly stored and reevaluate your Website.
    Data Analytics Course in Bangalore

    ReplyDelete
  105. Thanks for posting the best information and the blog is very important.artificial intelligence course in hyderabad

    ReplyDelete
  106. Very wonderful informative article. I appreciated looking at your article. Very wonderful reveal. I would like to twit this on my followers. Many thanks! .
    Data Analytics training in Bangalore

    ReplyDelete
  107. Stupendous blog huge applause to the blogger and hoping you to come up with such an extraordinary content in future. Surely, this post will inspire many aspirants who are very keen in gaining the knowledge. Expecting many more contents with lot more curiosity further.

    data science course in faridabad

    ReplyDelete
  108. Excellent effort to make this blog more wonderful and attractive.
    Best Data Science courses in Hyderabad


    ReplyDelete


  109. Nice post. I used to be checking constantly this blog and I am impressed! Extremely useful info particularly the ultimate section 🙂 I take care of such information a lot. I was seeking this certain information for a long time. Thank you and best of luck.
    essay on the person i admire the most

    ReplyDelete

Post a Comment