Posted On Sep 18

This job posting has expired

Advanced Data Engineer


Location : Bengaluru, Karnataka

Headquarters : United States

Hiring Mode : Full Time

Experience : Mid Level

Bengaluru, Karnataka
Deliver business value through Right and Fast partnership
Job Activities
  • We are looking for an Advanced Data Quality Assurance Engineer that will lead development, implementation and execution of tests (manual and automated) to ensure extracted and transformed data is loaded accurately from various sources (3rd party, Enterprise Analytics, IoT, internal) to the destination in the Honeywell analytics platform (Databricks, Snowflake, other MPP). The Advanced Data QA Engineer will be responsible for assuring Data Integrity, Data Validation and Data Completeness in the landing, staging and publishing layer. The Advanced QA Data Engineer will also perform data reconciliation, data profiling and publish reports on data quality metrics. The Advanced QA Data Engineer will plan, coordinate, and execute data quality activities on critical data sets for the Honeywell business.
  • Review and understand business requirements and technical designs for data pipelines (ETL) and models in the Honeywell analytics platform
  • Create comprehensive test plans and test cases for testing data pipelines for multiple storage solutions, including distributed platforms such as Databricks, Hadoop and MPP databases, BI reports
  • Plan, coordinate, and execute testing activities; Identify, record, and track defects
  • Design, develop, and execute automation scripts for ETL & Data Storage Testing
  • Perform thorough regression testing when defects are resolved
You must Have
  • Bachelor's degree in Computer Science, Engineering, Applied Mathematics or related field
  • 6-8 years working experience in quality assurance, preferably in Big data environment, Data quality and Data Warehouse
  • Strong knowledge of QA methodologies, data quality framework, tools, and processes
  • Experience in writing comprehensive test plans, test cases, test scripts and performing data issue/root cause analysis
  • Hands-on experience with automated testing tools and test data management
  • Hands-on experience with data quality tools (Informatica IDQ, SAS Dataflux, Trillium etc.)
  • Experience with complex SQL and scripting (Perl, Python, Java etc.)
  • Experience using the Hadoop ecosystem (Spark, Hive, NiFi, Informatica BDM, Sqoop, Flume, etc.)
  • Effective communication skills and business acumen
We Value
  • Consistent and timely decision making in the face of complexity, balancing systematic analysis with decisiveness
  • Committed practices that adhere to the principles of the standard data quality dimensions and quality enforcement
  • Dedicated efforts to build a robust business glossary, metadata, data catalog, data dictionary and data lineage
  • Understanding of global data privacy regulations (GDPR, CCPA etc.)
  • Experience working with in Agile and Scrum methodologies
  • Experience in regulated industries and controlled environments
  • Experience working with remote and global teams and cross team collaboration
  • Experience in working with data from enterprise systems (ERPs, CRMs, Marketing tools etc.)
  • Working knowledge of software best practices, like Test-Driven Development (TDD)
  • Working knowledge in ETL/BI Testing and cloud-based deployments (Azure, AWS, GCP etc.)
  • Working knowledge of branching, build, deployment, CI/CD methodologies such as Octopus and Bamboo
Additional Information
JOB ID: req305086
Category: Engineering
Location: HW Camp II,Bldgs 9A&9B,Plot C2,RMZ Ecoworld,Varturhobli,Sarjapur Marathahalli Outer Ring Road,Bangalore,KARNATAKA,560103,India