Experience in Apache Flume for collecting, aggregating and moving huge chunks of data from various sources such as webserver, telnet sources etc.Experienced in job workflow scheduling and monitoring tools like Oozie.
Experience in importing and exporting data using Sqoop from HDFS to Relational Database.Extensive experienced in working with structured data using Hive QL, join operations, writing custom UDF’s and experienced in optimizing Hive Queries.Strong experience in analyzing large amounts of data sets writing Pig scripts and Hive queries.Extensive experience writing custom Map Reduce programs for data processing and UDFs for both Hive and Pig in Java.Extensive experienced in working with semi/unstructured data by implementing complex map reduce programs using design patterns.Good exposure on usage of NoSQL databases column-oriented HBase and Cassandra.Excellent knowledge on Hadoop Architecture and ecosystems such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, YARN and Map Reduce programming paradigm.High Exposure on BigData technologies and Hadoop ecosystem, In - depth understanding of Map Reduce and the Hadoop Infrastructure.Proficiency in Java, Hadoop Map Reduce, Pig, Hive, Oozie, Sqoop, Flume, Hbase, Scala, Spark, Kafka, Storm, Impala and NoSQL Databases.Above 4 Years of working experience in data analysis and data mining using Big Data Stack.
#Aqua data studio direct output to a file software
0 kommentar(er)
