1,120 Data Lakes Jobs

Job Title: GCP Data Engineer Employment Type: Permanent Industry of the Employer: IT / Software Services Department / Functional Area: Data Engineering, Cloud Engineering Job Description GREETINGS FROM HUCON Solutions Hiring for Leading MNC GCP Data Engineer Role: GCP Data Engineer Skills: GCP, Python, SQL, BigQuery, ETL Data Pipeline Experience: 59 Years Locations: Chennai, Kochi, Bangalore, Hyderabad, Pune Eligibility Criteria Strong hands-on experience in Python, Pandas, NumPy Expertise in SQL and solid understanding of Data Warehousing concepts In-depth knowledge of GCP Services including: BigQuery, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions Experience with Docker, Kubernetes, GitHub Strong communication and analytical skills Working experience with PySpark, Data Modeling, Dataproc, Terraform Google Cloud Professional Data Engineer certification is highly preferred Role Responsibilities Design, develop, and manage robust and scalable ETL / ELT pipelines on GCP using Dataflow, Cloud Run, BigQuery, Pub/Sub, and Cloud Composer Implement data ingestion workflows for structured and unstructured data sources Build and maintain data warehouses and data lakes using BigQuery, Cloud Storage, and other GCP tools Work with data modeling, architecture, and ETL/ELT frameworks Ensure best practices in performance, optimization, and cloud data management Keywords / Skills GCP, Python, SQL, BigQuery, ETL, Data Pipeline, Data Engineering, Cloud Run, Pub/Sub, Cloud Storage, Dataproc, Terraform, Kubernetes, Docker, Dataflow Total Experience: 5 to 9 Years Salary Type: Yearly Annual Salary Offered: As per company standards Job Type: Full Time Shift Type: Day Shift / Rotational (based on project requirement) Location of the Job: Chennai | Kochi | Bangalore | Hyderabad | Pune

Data Engineer Azure Data Factory, SQL, Python, Databricks, ETL  Data Engineer .Net + Azure Data Factory  We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining data systems and architectures that support our business needs. This role requires expertise in working with large datasets, cloud technologies, and advanced data platforms to ensure the availability, quality, and accessibility of data for business analytics and decision-making. Key Responsibilities: Design, build, and maintain data pipelines to collect, process, and store data efficiently from various sources. Work with cross-functional teams to understand business requirements and deliver data solutions that meet the needs of the organization. Optimize data storage and retrieval methods to enhance system performance and data quality. Integrate data from multiple sources (databases, data lakes, cloud storage, etc.) to build comprehensive data sets. Build and maintain data infrastructure, ensuring it is scalable, reliable, and secure. Implement and manage data governance policies, ensuring data accuracy, consistency, and compliance. Conduct data modeling and provide insights into the data through advanced analytics tools and reports. Perform data transformations and data wrangling tasks to prepare data for analysis. Troubleshoot data issues and collaborate with stakeholders to resolve technical challenges. Ensure the integrity of data pipelines and systems by conducting routine testing and validation. Required Skills and Qualifications: Bachelors degree in Computer Science, Engineering, Information Systems, or related field. Proven experience as a Data Engineer or in a similar role, with a minimum of [X] years of experience. Proficiency in data engineering tools and technologies such as SQL, Python, Java, Scala, and ETL frameworks. Experience working with cloud platforms (AWS, Azure, GCP) and data storage solutions (e.g., Redshift, Snowflake, BigQuery). Solid understanding of data modeling, database design, and cloud data architectures. Hands-on experience with data warehousing concepts and tools (e.g., Apache Hive, Apache Spark). Familiarity with data orchestration tools such as Apache Airflow, Azure Data Factory. Knowledge of real-time data streaming technologies (e.g., Kafka, Kinesis) is a plus. Strong problem-solving skills and ability to troubleshoot complex data issues. Familiarity with data security best practices and data privacy regulations (e.g., GDPR, HIPAA).

Senior Snowflake Data Engineer Location: PAN India Experience: 8+ Years Skills: Snowflake, dbt, FiveTran, Snowpipe, AWS (MWAA, S3, Lambda), GitHub CI/CD Job Description We are looking for an experienced Senior Snowflake Data Engineer with strong expertise in modern data warehousing, cloud technologies, and ELT pipeline development. The ideal candidate should have deep hands-on experience in Snowflake, dbt, cloud environments, and CI/CD practices, with the ability to design scalable and efficient data solutions. Key Responsibilities Analyze, integrate, model, and interpret large and complex datasets from multiple sources. Design and implement ELT data pipelines using dbt with Snowflake as the primary cloud data warehouse. Build efficient and scalable data transformation pipelines using dbt at an advanced level. Work with ETL/ELT and data governance tools such as FiveTran and Alation. Utilize advanced Snowflake features such as RBAC, Dynamic Tables, and various optimization techniques. Ensure strong data modelling and warehousing practices across diverse database technologies. Manage orchestrations using Apache Airflow or AWS MWAA, along with CI/CD pipelines. Oversee continuous deployment, monitoring, and operations of data solutions using GitHub Actions, Terraform, and other DevOps tools. Collaborate with technical and non-technical stakeholders through effective communication. Contribute to building future-state Data Warehouse capabilities using cutting-edge technologies. Adapt and work efficiently within Agile methodology. Preferred Qualifications 2+ years of hands-on experience with Snowflake as a Cloud Data Warehouse and Data Lake platform. Strong understanding of cloud environments, especially AWS (S3, Lambda, MWAA). Airline industry domain experience is a plus.

Role Overview: As a Lead Data Engineer specializing in Databricks & Master Data Management, you will play a crucial role in designing, developing, and optimizing the next-generation data platform. Your responsibilities will include leading a team of data engineers, providing technical guidance, mentorship, and ensuring the scalability and high-performance of data solutions. Key Responsibilities: - **Technical Leadership:** - Lead the design, development, and implementation of scalable and reliable data pipelines using Databricks, Spark, and other relevant technologies. - Define and enforce data engineering best practices, coding standards, and architectural patterns. - Provide technical guidance and mentorship to junior and mid-level data engineers. - Conduct code reviews to ensure the quality, performance, and maintainability of data solutions. - **Databricks Expertise:** - Architect and implement data solutions on the Databricks platform, including Databricks Lakehouse, Delta Lake, and Unity Catalog. - Optimize Spark workloads for performance and cost efficiency on Databricks. - Develop and manage Databricks notebooks, jobs, and workflows. - Proficiently use Databricks features such as Delta Live Tables (DLT), Photon, and SQL Analytics. - **Master Data Management:** - Lead the technical design and implementation of the MDM solution for critical domains (e.g., Customer, Product, Vendor). - Define and implement data quality rules, entity resolution, matching, and survivorship logic to create and maintain Golden Records. - Partner with Data Governance and Data Stewardship teams to ensure organizational policies, standards, and data definitions for master data assets. - Ensure seamless provisioning of high-quality master data from the MDM/Lakehouse platform to downstream systems (ERP, CRM, BI). - **Pipeline Development & Operations:** - Develop, test, and deploy robust ETL/ELT pipelines for data ingestion, transformation, and loading from various sources. - Implement monitoring, alerting, and logging for data pipelines to ensure operational excellence. - Troubleshoot and resolve complex data-related issues. - **Collaboration & Communication:** - Work closely with cross-functional teams such as product managers, data scientists, and software engineers. - Communicate complex technical concepts clearly to both technical and non-technical stakeholders. - Stay updated with industry trends and emerging technologies in data engineering and Databricks. Qualifications Required: - Extensive hands-on experience with Databricks platform, including Databricks Workspace, Spark on Databricks, Delta Lake, and Unity Catalog. - Strong proficiency in optimizing Spark jobs and understanding Spark architecture. - Experience with Databricks features like Delta Live Tables (DLT), Photon, and Databricks SQL Analytics. - Deep understanding of data warehousing concepts, dimensional modeling, and data lake architectures. - Familiarity with data governance and cataloging tools (e.g., Purview, Profisee).,

As a candidate for this role, you would be responsible for the following: - Understanding of Spark core concepts like RDDs, DataFrames, DataSets, SparkSQL, and Spark Streaming. - Experience with Spark optimization techniques. - Deep knowledge of Delta Lake features like time travel, schema evolution, data partitioning. - Ability to design and implement data pipelines using Spark and Delta Lake as the data storage layer. - Proficiency in Python/Scala/Java for Spark development and integrate with ETL process. - Knowledge of data ingestion techniques from various sources (flat files, CSV, API, database). - Understanding of data quality best practices and data validation techniques. Qualifications required for this role: - Understanding of data warehouse concepts and data modelling techniques. - Expertise in Git for code management. - Familiarity with CI/CD pipelines and containerization technologies. - Nice to have experience using data integration tools like DataStage/Prophecy/Informatica/Ab Initio.,

As an Executive - SAP Support at House of Shipping, you will be responsible for designing, implementing, and managing data solutions using Azure Data services to support data-driven decision-making processes. Your main focus will be on creating robust data pipelines and architectures for efficient Extraction, Transformation, and Loading (ETL) operations from various sources into the Data warehouse or Data Lakehouse. Your key responsibilities will include: - Designing and developing data solutions on Azure - Managing data integration workflows using Azure Data Factory - Implementing data storage solutions using Azure Synapse SQL Pool and other Azure services - Monitoring and optimizing the performance of data pipelines and storage solutions Additionally, you will collaborate with Data analysts, Developers, and Business stakeholders to understand data requirements and troubleshoot data-related issues to ensure data accuracy, reliability, and availability. To succeed in this role, you should have proficiency in: - Azure Data Factory - Azure Synapse Analytics - Azure Data Lake Storage - SQL and RDBMS systems - Data modeling - ELT batch design - Data integration techniques - Python programming - Serverless architecture using Azure Functions Experience with Spark, Streaming services, Azure AI services, PowerBI, and Data Lake house architecture will be beneficial. Preferred certifications for this role include Microsoft Certified: Azure Data Engineer Associate or Microsoft Certified: Fabric Analytics Engineer Associate. If you are passionate about data solutions and thrive in a collaborative environment to deliver effective solutions, we welcome you to join our team at House of Shipping.,

As a Power BI Developer/Analyst, your role involves designing, developing, and deploying business intelligence reports using Microsoft's Power BI. You will work closely with stakeholders to gather requirements, create data models, and provide insights through reports and dashboards. Key Responsibilities: - Develop and maintain Power BI reports, dashboards, and visualizations. - Translate business needs into technical specifications for BI tools. - Collaborate with business analysts, data engineers, and other stakeholders to gather data requirements. - Create and manage data connections, transformations, and models using Power BI. - Ensure data accuracy and consistency across reports and dashboards. - Provide training and support to end-users on Power BI solutions. - Stay updated with new Power BI features and best practices. Qualifications: - Proficiency in Power BI, including DAX (Data Analysis Expressions) and Power Query. - Strong knowledge of SQL for querying databases. - Experience with data modelling, ETL processes, and creating measures. - Understanding of relational databases, data warehouses, and data lakes. - Excellent analytical and problem-solving skills. - Good communication skills to translate technical solutions to non-technical stakeholders. - Knowledge of cloud platforms like Azure is a plus.,

URGENT HIRING !!!   location's : Germany-Sweden-Canada-Australia-UK-Singapore ( Not In India )   Benefits : Medical Insurances , Travel allowances , Flight Tickets , Meals , etc   For more information call or whatsapp +91 8527600240  Key Responsibilities: Design and build scalable data pipelines to process and store data Work with large datasets to ensure data quality and integrity Create and maintain data warehouses and data lakes Automate data workflows and schedule jobs using tools like Airflow Collaborate with other teams to understand data needs and deliver solutions Optimize data systems for performance, speed, and reliability Ensure security and compliance with data privacy regulations

Role Overview: As a member of Periscope's technology team based in either Bengaluru or Gurugram, you will play a crucial role in developing and deploying core enterprise products, ensuring that McKinsey's technology remains at the forefront of innovation. Your responsibilities will include building and enhancing deployment scripts and toolsets for cloud-based solutions on AWS and Azure platforms, with a focus on database management, Kubernetes cluster setup and monitoring, performance tuning, and continuous delivery. Key Responsibilities: - Spend approximately 80% of your time on software development projects, actively engaging in hands-on tasks. - Explore new open-source libraries, adopt unfamiliar technologies independently, and master various frameworks and methodologies. - Leverage your expertise in agile engineering practices to drive continuous improvement within your team. - Provide mentorship to other DevOps engineers to enhance the organizational capabilities. Qualifications Required: - Bachelor's degree in computer science, engineering, or a related field. - Minimum of 6 years of experience in DevOps or Cloud Engineering roles. - Proficiency in Microsoft Azure services such as Azure Data Lake, Azure Databricks, Azure Data Factory (ADF), Azure Functions, Azure Kubernetes Service (AKS), and Azure Active Directory. - Hands-on experience with Databricks for data engineering and analytics. - Strong scripting skills in Python or Bash. - Familiarity with Infrastructure as Code (IaC) tools like Terraform, ARM templates, or Bicep. - Experience with containerization and orchestration tools like Docker and Kubernetes. - Knowledge of version control systems (e.g., Git) and CI/CD tools (e.g., Azure DevOps, GitHub Actions). - Exceptional problem-solving and analytical abilities. - Excellent communication and collaboration skills.,

As an Azure Databricks & Data lakes expert, your role will primarily involve utilizing your skills and competencies in areas such as data pipeline design, data quality, machine learning model development, data integration, data security, and more. Your proficiency in Databricks platform and secondary skillset in Oracle or MS SQL DB will be crucial for the successful execution of your responsibilities. Here's a breakdown of what will be expected from you: **Key Responsibilities:** - Designing and developing advanced data pipelines - Ensuring data quality and governance throughout the processes - Developing and maintaining machine learning models - Implementing data integration processes effectively - Adhering to data security and privacy regulations - Developing tools for data visualization - Designing and developing data warehouse and data marts - Implementing ETL processes efficiently - Ensuring data governance and compliance - Utilizing SQL and Python for data operations - Applying knowledge of Big Data technologies such as Hadoop and Spark - Leveraging cloud computing platforms like AWS, Azure, and GCP - Working on data modeling and architecture - Conducting advanced analytics and predictive modeling - Staying updated on data privacy laws and regulations - Utilizing BI tools like Tableau and PowerBI effectively - Demonstrating strong problem-solving skills - Communicating and presenting effectively - Leading projects and teams with strong project management skills **Qualifications Required:** - Proficiency in Databricks platform - Experience in data pipeline design and development - Knowledge of data security and privacy regulations - Strong proficiency in SQL and Python - Familiarity with Big Data technologies like Hadoop and Spark - Experience with cloud computing platforms (AWS, Azure, GCP) - Understanding of data modeling and architecture principles - Proficiency in BI tools such as Tableau and PowerBI - Excellent problem-solving skills - Outstanding communication and presentation skills - Experience in project management and team leadership This is an exciting opportunity for you to showcase your expertise in Azure Databricks & Data lakes while contributing to the growth of the organization.,

As a Principal Engineer- Data and Analytics, your role will involve developing and implementing data engineering projects, defining reference data architecture, and leading the selection, deployment, and management of Data tools, platforms, and infrastructure. You will be responsible for guiding a team of data engineers, overseeing the design and deployment of Data solutions, and driving partnerships with vendors for collaboration and capability building. Additionally, you will collaborate with client teams, propose tailored Data solutions, and lead client engagements from initiation to deployment. Key Responsibilities: - Develop and implement data engineering projects, including enterprise data hub or Big data platform - Define reference data architecture and differentiate new Data services/offerings - Lead the selection, deployment, and management of Data tools, platforms, and infrastructure - Guide a team of data engineers technically and oversee the design, development, and deployment of Data solutions - Drive partnerships with vendors for collaboration and capability building - Collaborate with client teams to propose tailored Data solutions and lead client engagements - Build re-usable Methodologies, Pipelines & Models for data science projects - Develop and implement data architecture solutions that support business requirements - Ensure compliance with regulatory and industry standards for data management and security - Develop and maintain data models, data warehouses, data lakes, and data marts - Maintain data quality, accuracy, and consistency across all data sources - Utilize data integration tools such as Informatica, Qlik Talend, and Apache NiFi - Experience with cloud computing platforms like AWS, Azure, or Google Cloud Platform - Proficiency in programming languages such as Python, Java, or Scala - Knowledge of data visualization tools such as Tableau, Power BI, or QlikView - Understanding of analytics and machine learning concepts and tools - Skilled in using relational database technologies and NoSQL databases - Strong expertise in cloud-based databases such as Azure datalake, Synapse, AWS Redshift, etc. - Knowledge of big data technologies like Hadoop, Spark, Snowflake, and Kafka - Ability to combine data from various sources into a centralized location using data integration techniques - People & Interpersonal Skills: Build and manage high-performing data teams, foster innovation and collaboration, work in diverse teams, and possess strong communication skills - Stay updated on the latest trends and developments in the Data domain Qualifications Required: - 10+ years of experience in the IT industry with a focus on Data engineering - 8+ years of data engineering or data architecture experience - Experience in RFP/proposals, presales activities, and business development - Masters or bachelors degree in relevant field - Ability to manage data projects and diverse teams - Experience in creating data and analytics solutions - Good knowledge of data visualization and reporting tools - Ability to normalize and standardize data as per Key KPIs and Metrics Please note that the above description is subject to your interpretations and might require adjustments based on your understanding of the role.,

As a highly skilled and experienced professional in data warehousing and data center architecture, you will be responsible for leading and supporting various initiatives. Your expertise in Data Warehousing, Data Lakes, Data Integration, and Data Governance, coupled with hands-on experience in ETL tools and cloud platforms like AWS, Azure, GCP, and Snowflake, will play a crucial role in this position. Key Responsibilities: - Architect and design scalable Data Warehousing and Data Lake solutions - Lead presales engagements and create proposals and solution designs for clients - Collaborate with cross-functional teams and estimate efforts/resources for customer requirements - Drive Managed Services opportunities and enterprise deal closures - Engage with clients globally and ensure solutions align with business goals and technical requirements - Maintain high standards of documentation and presentation for client-facing materials Qualification Required: - Bachelor's or Master's degree in Computer Science, Information Technology, or related field - Certifications in AWS, Azure, GCP, or Snowflake are advantageous - Experience in consulting or system integrator environments - Strong understanding of Data Warehousing, Data Lakes, Data Integration, and Data Governance - Hands-on experience with ETL tools and exposure to cloud environments - Minimum of 2 years of presales experience - Experience in enterprise-level deals and Managed Services - Ability to handle multi-geo engagements - Excellent presentation and communication skills - Solid grasp of effort estimation techniques for customer requirements With your technical leadership capabilities and ability to manage complex enterprise deals, you are expected to excel in this role by delivering high-quality solutions that meet client needs effectively.,

Role Overview: YASH Technologies is seeking Data Lake Professionals with a strong background in data and analytics to join our team in Hyderabad, Indore, and Pune. As a Data Architect, you will be responsible for data integration, modelling, and architecture on large-scale projects. Your expertise in technologies such as Spark, SQL, and Python will be crucial in driving business transformation and enhancing stakeholder experiences. Key Responsibilities: - Utilize your 10+ years of experience in data and analytics to design and implement data lakes, data warehouses, and Lakehouse architectures. - Demonstrate proficiency in data ingestion techniques, metadata management, and working with tools like ADF, Databricks, and BI tools. - Ensure governance and compliance by adhering to data governance frameworks, security standards, and regulatory requirements such as GDPR and CCPA. - Leverage your soft skills including strong communication, leadership, and stakeholder management to mentor teams and influence cross-functional decisions. - Apply your domain knowledge in ERP, manufacturing, engineering, or supply chain, with SAP experience being a plus. Qualifications Required: - Bachelor's degree in a relevant field such as Computer Science, Information Technology, or Engineering. - Proven experience as a Data Architect on large-scale projects. - Strong understanding of data integration, modelling, and architecture principles. - Hands-on experience with technologies including Spark, SQL, Python, and data ingestion techniques. - Familiarity with ADF, Databricks, and BI tools. - Knowledge of data governance frameworks, security standards, and regulatory compliance. - Excellent communication, leadership, and stakeholder management skills. Additional Details: YASH Technologies is committed to providing a supportive and inclusive team environment where you can develop your career while leveraging career-oriented skilling models. Our Hyperlearning workplace is based on principles of flexible work arrangements, trust, transparency, and stable employment with a great atmosphere and ethical corporate culture. Join us in creating positive changes in an increasingly virtual world.,

Role Overview: You will be responsible for being the development owner of a module in the Zenoti product. Your role will involve designing, developing, testing, releasing, and maintaining components of Zenoti. Collaborating with a team of PM, DEV, and QA to release features and working in a team following agile development practices (SCRUM) will be crucial. You will focus on building usable software, released at high quality, running at scale, and adopted by customers. Additionally, you will learn to scale your features to handle 2x ~ 4x growth every year and manage code dealing with millions of records and terabytes of data. Releasing new features into production every month and receiving real feedback from thousands of customers to refine your designs will be part of your responsibilities. You are expected to take pride in your work and obsess about the quality of the work you produce. Key Responsibilities: - Be the development owner of a module in the Zenoti product - Design, develop, test, release, and maintain components of Zenoti - Collaborate with a team of PM, DEV, and QA to release features - Work in a team following agile development practices (SCRUM) - Build usable software, released at high quality, runs at scale, and is adopted by customers - Learn to scale your features to handle 2x ~ 4x growth every year and manage code that has to deal with millions of records and terabytes of data - Release new features into production every month and get real feedback from thousands of customers to refine your designs - Be proud of what you work on, obsess about the quality of the work you produce Qualifications Required: - 7+ years of experience in designing and developing code on Microsoft SQL Server - Strong programming background and experience on the Microsoft stack a plus - A deep understanding of SQL Server, T-SQL, stored procedures, and SQL performance tuning - Experience in working with large scale production systems a plus - Strong and demonstrated ability to design solutions for complex database problems - Strong logical, analytical and problem-solving skills - Experience with ensuring the data consistency and data validation frameworks is a plus - Excellent communication skills - Can work in a fast-paced, ever-changing, startup environment Additional Company Details: Zenoti provides an all-in-one, cloud-based software solution for the beauty and wellness industry. Their solution enables users to seamlessly manage every aspect of the business in a comprehensive mobile solution. With a portfolio of global brands and recent achievements like surpassing a $1 billion unicorn valuation, Zenoti is committed to empowering people to feel good and find their greatness. (Note: The benefits section was omitted as it was not present in the provided JD),

As a Data Lake Engineer at BairesDev, you will play a crucial role in developing and optimizing scalable data lake systems using popular open source technologies like Apache Iceberg, Delta Lake, and Apache Hudi. Your contributions will not only impact the efficiency of data storage and processing but also enable flexible data access patterns through schema-on-read solutions. Your expertise in data governance, metadata management, and collaboration with engineering teams will be key in delivering innovative data storage and management solutions. **Key Responsibilities:** - Contribute actively to data lake and related open source projects. - Develop and optimize data lake architectures for scalable data storage and processing. - Implement schema-on-read solutions to enable flexible data access patterns. - Build data governance frameworks to ensure data quality and compliance. - Design and implement metadata management systems for data discovery and lineage. - Collaborate with engineering teams on system integration and deployment. **Qualifications Required:** - 10+ years of experience in software development. - Strong expertise in data lake architectures and large-scale data storage systems. - Deep understanding of schema-on-read concepts and flexible data modeling. - Proficiency in data governance frameworks and compliance management. - Experience with metadata management and data cataloging systems. - Core contributions to Apache open source projects (Iceberg, Delta Lake, Hudi, or similar). - Advanced level of English proficiency. At BairesDev, you'll enjoy excellent compensation, paid parental leave, vacation, and national holidays. You'll work in an innovative and multicultural environment, collaborating with the global Top 1% of talent in each area. The company offers a supportive environment with mentorship, promotions, skill development, and diverse growth opportunities. Join the global team at BairesDev to unleash your unique talents and make a significant impact in the world of technology. Apply now to start your exceptional career journey!,

As a Senior Associate, Data Lake Governance within the CAO Chief Data Office, you will have a significant impact in the world of data governance by designing, implementing, and monitoring governance frameworks for the Data Lake. You will play a pivotal role in this process and collaborate with cross-functional teams to ensure alignment with internal and regulatory requirements. This role offers you the opportunity to build a new function from the ground up in a complex and evolving environment, providing you with significant cross-functional and leadership visibility. **Key Responsibilities:** - Design and document operating models and governance frameworks for data, datasets, and data assets within the CAO Data Lake, including governance tollgates. - Engage with stakeholders from Data Strategy, Data Governance, Data Management, Product, Technology, and Information Architecture to review, validate, and refine governance frameworks. - Lead and facilitate meetings and working groups to drive consensus and adoption of governance frameworks and practices. - Implement governance processes and monitor compliance, supporting remediation activities as needed. - Align governance requirements across internal and external (regulatory) standards. - Provide input on the selection and implementation of tools that support data lake governance activities. - Distinguish between required and recommended governance practices, ensuring clarity and prioritization. - Adapt to ambiguity and complexity, building new processes and solutions in a rapidly evolving space. **Qualifications Required:** - 5+ years of experience in Data Governance, Data Management, or Data Strategy within the financial sector. - Experience in building and developing governance operating models/frameworks for data lakes or other large-scale data repositories. - Understanding of data architecture principles. - Experience with Agile and SDLC processes and associated tools/methodologies (Confluence, Jira, Kanban). - Experience with AWS or other cloud-based platforms. - Proven ability to develop strong partnerships and collaborations across cross-functional teams. - Experience in defining and implementing multi-faceted projects or programs. - Strong analytical, problem-solving, and strategic thinking skills. - Comfortable with ambiguity, complexity, and continuously changing priorities. - Intermediate to advanced knowledge of Microsoft desktop productivity tools (Excel, PowerPoint, Visio, Word, SharePoint, Teams). The job also involves collaborating with stakeholders from various domains, leading meetings to drive consensus, and monitoring compliance to ensure governance frameworks are effectively implemented. Additionally, you will have the opportunity to provide input on tools, adapt to evolving requirements, and prioritize governance practices for optimal outcomes.,

As a Data Engineer, your role involves leading the design and implementation of highly scalable and fault-tolerant data pipelines using modern platforms such as Azure Synapse, Snowflake, or Databricks workflows. Your key responsibilities include: - Developing, constructing, testing, and maintaining robust data architectures to ensure optimal data flow and ingestion from diverse sources. - Leveraging expertise in the Azure Data Platform components, including Azure Data Factory (ADF) for orchestration, Azure Data Lake (ADLS) for storage, and Azure SQL Database for operational data storage. - Applying strong proficiency in Python or Scala to develop complex data transformation logic and custom ETL/ELT processes. - Exhibiting SQL mastery by writing advanced, efficient queries, performing performance tuning, and optimizing database schemas and procedures. - Designing and developing efficient PL/SQL procedures for data manipulation and business logic within relational databases. - Implementing processes and systems to monitor data quality, ensuring accuracy, completeness, and reliability across all data assets. - Collaborating with BI analysts, providing clean, optimized data feeds, and supporting the development of dashboards using tools like Power BI. - Utilizing experience with general cloud platforms (AWS and Azure) and associated data services to inform architectural decisions and potential future integrations. Qualifications: - The successful candidate must possess 10+ years of progressive experience in data engineering, emphasizing architecture and optimization. - Technical expertise required includes extensive experience in Cloud Data Warehousing, programming proficiency in Python or Scala, advanced query writing, performance tuning, and optimization, hands-on experience with PL/SQL procedures, and familiarity with Azure Data Platform and major cloud platforms. - Professional competencies should include proven ability to work independently, manage multiple priorities, meet deadlines, excellent problem-solving, analytical, and communication skills, and experience in mentoring or leading technical teams is a significant plus. Please note, the additional details of the company mentioned in the job description are omitted.,

As an AWS with Databricks professional, you will be responsible for designing, building, and optimizing scalable data pipelines using Databricks on AWS. Your key responsibilities will include: - Developing ETL/ELT workflows - Integrating structured and unstructured data - Ensuring data quality and performance You should be proficient in Python, Pyspark, and SQL, with hands-on experience in AWS services such as S3, Glue, Lambda, and Redshift. Additionally, you should be skilled in Delta Lake, data lake architecture, and job orchestration. It is essential to have a strong understanding of data modeling, governance, and security best practices. As an Agile practitioner, you should have Git expertise and excellent communication skills. You should also be adept at translating business needs into technical user stories and working with large, complex code bases. No additional details about the company were mentioned in the job description.,

As a Databricks Engineer, your role involves designing and developing ETL pipelines using Azure Data Factory (ADF) for data ingestion and transformation. You will collaborate with Azure stack modules such as Data Lakes and SQL Data Warehouse to create robust data solutions. Your responsibilities will include writing SQL, Python, and PySpark code for efficient data processing, translating business requirements into technical designs, developing mapping documents, and communicating project status with stakeholders to ensure smooth project execution. Key Responsibilities: - Design and develop ETL pipelines using Azure Data Factory (ADF) for data ingestion and transformation. - Collaborate with Azure stack modules like Data Lakes and SQL Data Warehouse to build robust data solutions. - Write SQL, Python, and PySpark code for efficient data processing and transformation. - Understand and translate business requirements into technical designs. - Develop mapping documents and transformation rules as per project scope. - Communicate project status with stakeholders, ensuring smooth project execution. Qualifications Required: - 4-10 years of experience in data ingestion, data processing, and analytical pipelines for big data and relational databases. - Hands-on experience with Azure services such as Azure Data Lake Storage (ADLS), Azure Databricks, Data Factory, Synapse, and Azure SQL Database. - Experience in SQL, Python, and PySpark for data transformation and processing. - Familiarity with DevOps and CI/CD deployments. - Experience in the insurance or financial industry is preferred. Please share your resume with Venku.Reddy@Valuemomentum.com if you are interested in this opportunity.,

As a Data Engineer at our firm, you will be responsible for supporting, delivering, and implementing Spendscape solutions in collaboration with our strong delivery teams and clients. Your key responsibilities will include: - Project scoping, data identification, extraction, processing, engineering, and enrichment - Data cleansing and categorization - Automatization of reoccurring tasks and debugging of data processing - Merging various internal and external data tables and sources using proprietary and third-party ETL and data-transformation tools or scripts such as Snaplogic, SQL, Python, and Snowflake - Continuous development and improvement of proprietary data extractor and ETL tools - Gathering client input, identifying their needs, and working closely with Software Development and Data Science teams to create scalable solutions - Building a deep understanding of the data model and the Spendscape solution to support client inquiries and troubleshoot issues - Implementing sustainable solutions and discussing the best implementation of the database for new or customized analytics In this role, you will have the opportunity for continuous learning, a voice that matters, and be part of a global community. Additionally, you will benefit from our world-class benefits package. Qualifications and Skills required for this role include: - Undergraduate degree in computer science, engineering, mathematics, information systems, or related field - 3+ years of relevant professional work experience in a data engineering function with an analytics firm - Strong coding knowledge in SQL or T-SQL - Understanding of data warehousing and data lake concepts - Experience in building operational ETL data pipelines and constructing relational and multi-dimensional data models - Drive for automatization and optimization - Strong problem-solving capabilities - Abilities in large data handling through tools like Microsoft SQL, Python, Git, and cloud data warehouses - Experience in Snaplogic, Talend, Alteryx is a plus - Experience in procurement and/or business intelligence is a plus - Excellent written and verbal communication skills in English Join us to grow your skills, drive lasting impact, and be part of a diverse and supportive community that values your contributions.,