QBoard » Big Data » Big Data - Spark » Talend and Apache Spark?

Talend and Apache Spark?

  • I am confused as to where Talend and Apache spark fit in the big data ecosystem as both Apache Spark and Talend can be used for ETL.

    Could someone please explain this with an example?

      September 9, 2021 1:04 PM IST
    0
  • Talend studio provides inbuilt components for spark is the main engine behind this. Due to the inbuilt components it decreases the coding time. But if you will code directly using spark with Scala java or python it needs time to build the common components. Talend makes life easier and it’s easy to adopt for the traditional etl developers. Example if someone comes from abi initio they can correlate by seeing the graph or lineage provided by Talend. But in order to extend the business component people need to write code I. Java with spark in the Talend studio. One more thing Talend takes care of packaging the jar and deploying it from windows to server and run and displays the result in its console.

     
      September 11, 2021 1:28 PM IST
    0
  • Talend is kind of tool based big data approach and supports all big data applications with in built components. Where as spark is code base approach and you need to write the code for use case.

     
      October 21, 2021 2:31 PM IST
    0
  • Talend studio provides inbuilt components for spark is the main engine behind this. Due to the inbuilt components it decreases the coding time. But if you will code directly using spark with Scala java or python it needs time to build the common components. Talend makes life easier and it’s easy to adopt for the traditional etl developers. Example if someone comes from abi initio they can correlate by seeing the graph or lineage provided by Talend. But in order to extend the business component people need to write code I. Java with spark in the Talend studio. One more thing Talend takes care of packaging the jar and deploying it from windows to server and run and displays the result in its console.
      October 23, 2021 4:11 PM IST
    0
  • In fact Talend Big Data studio generates Apache Spark code for the designed ETL jobs. So in essence they are the same.
      September 15, 2021 11:27 PM IST
    0