Big Data Engineer
HR Hit: Azure Service Bus
Main Duties and Responsibilities:
* Using NiFi to automate the flow of data between software systems.
* Performance tuning, executing and designing complex hive HQL's.
* Participate in design, development and delivery of data from operational systems and files into ODSs (operational data stores), downstream Data Marts and files.
* Troubleshoot and develop on Hadoop technologies including HDFS, Hive, Pig, Flume, HBase, Spark, Impala and Hadoop ETL development via tools such as Informatica,
* Translate, load and present disparate data sets in multiple formats and multiple sources including JSON, Avro, text files, Kafka queues, and log data.
* Has strong Core Java Programming experience to apply in Data Integration.
|Salary||0 to 0|
|Years of Experience ||5+ to 10 years|
|Minimum Education ||-|
|Willingness to Travel||-|
|Hours per week||0|