5,798 Data Engineer Jobs in Pune

We have an exciting opportunity for the role of Data Engineer. Please find the details below: Job Description: Total experience required: 6+ yearsMinimum 3 years of experience in PySparkLocation: Pune Chennai and Bangalore. Strong programming skills in Python and PySpark (Scala is preferred)Experience in designing and implementing CI/CD, build management, and development strategiesHands-on experience with SQL and SQL analytical functionsExposure to key business, architectural, and technical decision-making processesOpportunity to get trained on AWS cloud technologyProficient in leveraging Spark for distributed data processing and transformationSkilled in optimizing data pipelines for efficiency and scalabilityExperience with real-time data processing and integrationFamiliarity with Apache Hadoop ecosystem componentsStrong problem-solving abilities for handling large-scale datasetsExcellent collaboration and communication skills for working with cross-functional teamsPrimary Skills: PySpark and SQL Secondary Skills: Experience with AWS, Azure, or GCP would be an added advantageIf interested, please apply. Best regards,HR Team, Capgemini

Data Engineer Azure Data Factory, SQL, Python, Databricks, ETL  Data Engineer .Net + Azure Data Factory  We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining data systems and architectures that support our business needs. This role requires expertise in working with large datasets, cloud technologies, and advanced data platforms to ensure the availability, quality, and accessibility of data for business analytics and decision-making. Key Responsibilities: Design, build, and maintain data pipelines to collect, process, and store data efficiently from various sources. Work with cross-functional teams to understand business requirements and deliver data solutions that meet the needs of the organization. Optimize data storage and retrieval methods to enhance system performance and data quality. Integrate data from multiple sources (databases, data lakes, cloud storage, etc.) to build comprehensive data sets. Build and maintain data infrastructure, ensuring it is scalable, reliable, and secure. Implement and manage data governance policies, ensuring data accuracy, consistency, and compliance. Conduct data modeling and provide insights into the data through advanced analytics tools and reports. Perform data transformations and data wrangling tasks to prepare data for analysis. Troubleshoot data issues and collaborate with stakeholders to resolve technical challenges. Ensure the integrity of data pipelines and systems by conducting routine testing and validation. Required Skills and Qualifications: Bachelors degree in Computer Science, Engineering, Information Systems, or related field. Proven experience as a Data Engineer or in a similar role, with a minimum of [X] years of experience. Proficiency in data engineering tools and technologies such as SQL, Python, Java, Scala, and ETL frameworks. Experience working with cloud platforms (AWS, Azure, GCP) and data storage solutions (e.g., Redshift, Snowflake, BigQuery). Solid understanding of data modeling, database design, and cloud data architectures. Hands-on experience with data warehousing concepts and tools (e.g., Apache Hive, Apache Spark). Familiarity with data orchestration tools such as Apache Airflow, Azure Data Factory. Knowledge of real-time data streaming technologies (e.g., Kafka, Kinesis) is a plus. Strong problem-solving skills and ability to troubleshoot complex data issues. Familiarity with data security best practices and data privacy regulations (e.g., GDPR, HIPAA).

Senior Snowflake Data Engineer Location: PAN India Experience: 8+ Years Skills: Snowflake, dbt, FiveTran, Snowpipe, AWS (MWAA, S3, Lambda), GitHub CI/CD Job Description We are looking for an experienced Senior Snowflake Data Engineer with strong expertise in modern data warehousing, cloud technologies, and ELT pipeline development. The ideal candidate should have deep hands-on experience in Snowflake, dbt, cloud environments, and CI/CD practices, with the ability to design scalable and efficient data solutions. Key Responsibilities Analyze, integrate, model, and interpret large and complex datasets from multiple sources. Design and implement ELT data pipelines using dbt with Snowflake as the primary cloud data warehouse. Build efficient and scalable data transformation pipelines using dbt at an advanced level. Work with ETL/ELT and data governance tools such as FiveTran and Alation. Utilize advanced Snowflake features such as RBAC, Dynamic Tables, and various optimization techniques. Ensure strong data modelling and warehousing practices across diverse database technologies. Manage orchestrations using Apache Airflow or AWS MWAA, along with CI/CD pipelines. Oversee continuous deployment, monitoring, and operations of data solutions using GitHub Actions, Terraform, and other DevOps tools. Collaborate with technical and non-technical stakeholders through effective communication. Contribute to building future-state Data Warehouse capabilities using cutting-edge technologies. Adapt and work efficiently within Agile methodology. Preferred Qualifications 2+ years of hands-on experience with Snowflake as a Cloud Data Warehouse and Data Lake platform. Strong understanding of cloud environments, especially AWS (S3, Lambda, MWAA). Airline industry domain experience is a plus.

AWS Data Engineer  Requirements  3+ year of experience working on AWS Cloud platform with strong experience in Python Knowledge on AWS services such as - AWS S3, Glue, API Gateway, Crawler, Athena, Cloudwatch, Lambda, EC2, Route53, IAM, Aurora/Dynamic DB, Redshift is an advantage Knowledge/experience on CI/CD deployment tools (CloudFormation, Terraform, Jenkins) Experience/knowledge with streaming technologies is must preferably Kafka Should have knowledge/experience with SQL Experience developing REST API Good analytical skills Knowledge or experience developing microservices Familiar working on Linux platforms Have good understanding on pros and cons and the cost impact of the AWS services being leveraged Good Communication skills

Duties/ Roles & Responsibilities Lead the design, optimization, and scaling of data pipelines using Data bricks, Spark, and advanced SQL. Drive architectural decisions, enforce best practices, and mentor teams on distributed data processing and lake house patterns. Collaborate with cross-functional partners to deliver high-quality, reliable data solutions that support analytics and business objectives.

Duties/ Roles & Responsibilities Lead the design, optimization, and scaling of data pipelines using Data bricks, Spark, and advanced SQL. Drive architectural decisions, enforce best practices, and mentor teams on distributed data processing and lake house patterns. Collaborate with cross-functional partners to deliver high-quality, reliable data solutions that support analytics and business objectives.

Job Description-  Data EngineerTotal yrs of exp should be 6+yrs   Must have 3+ years in Pyspark. Strong programming experience, Python, Pyspark, Scala is preferred. Experience in designing and implementing CI/CD, Build Management, and Development strategy. Experience with SQL and SQL Analytical functions, experience participating in key business, architectural and technical decisions Scope to get trained on AWS cloud technology Proficient in leveraging Spark for distributed data processing and transformation. Skilled in optimizing data pipelines for efficiency and scalability. Experience with real-time data processing and integration. Familiarity with Apache Hadoop ecosystem components. Strong problem-solving abilities in handling large-scale datasets. Ability to collaborate with cross-functional teams and communicate effectively with stakeholders. Primary Skills : Pyspark SQL Secondary Skill: Experience on AWS/Azure/GCP would be added advantage

As a Snowflake Data Engineer at Barclays, you will play a pivotal role in evolving the infrastructure and deployment pipelines, driving innovation and operational excellence. Leveraging cutting-edge technology, you will be responsible for building and managing robust, scalable, and secure infrastructure to ensure the seamless delivery of digital solutions. **Key Responsibilities:** - Build and maintain data architectures pipelines for the transfer and processing of durable, complete, and consistent data. - Design and implement data warehouses and data lakes that manage data volumes and velocity while adhering to security measures. - Develop processing and analysis algorithms suitable for the complexity and volumes of data. - Collaborate with data scientists to build and deploy machine learning models. **Qualifications Required:** - Proficiency in Advanced SQL, PySpark, Snowflake Architecture, and AWS (or other Cloud services). - Highly valued skills may include Tableau, DPT, and Data Modelling. In this role, you will be based out of Pune. Your primary purpose will be to create and maintain systems that collect, store, process, and analyze data effectively, ensuring accuracy, accessibility, and security. As an Analyst, you are expected to provide specialist advice and support to stakeholders, perform activities in a timely and high standard manner, and may lead specific processes within a team. You will collaborate with colleagues, lead and supervise a team, allocate work requirements, and coordinate team resources. All colleagues at Barclays are required to uphold the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship, as well as demonstrate the Barclays Mindset - to Empower, Challenge, and Drive.,

As a Data Engineer - Snowflake at Barclays, you will play a crucial role in evolving the infrastructure and deployment pipelines, driving innovation and operational excellence. Your main responsibilities will include harnessing cutting-edge technology to build and manage robust, scalable, and secure infrastructure to ensure the seamless delivery of digital solutions. Key Responsibilities: - Strong hands-on expertise in Snowflake, including data modeling, SQL, performance tuning, Snowflake objects, and features. - Proficiency in SQL and experience with ETL/ELT development. - Working experience with cloud-based data platforms, preferably AWS. - Familiarity with data formats such as Parquet, Iceberg, and JSON. - Experience with data orchestration tools. - Understanding of data architecture, data warehousing concepts, and agile delivery practices. - Working knowledge of Tableau or similar BI tools for downstream consumption. Desirable Skillsets: - Design, develop, test, and deploy end-to-end data solutions on Snowflake within an agile delivery model. - Build data pipelines for ingestion, transformation, and consumption of structured and semi-structured data. - Design and implement data models and products to support analytical and reporting needs. - Develop and optimize Snowflake objects like databases, schemas, tables, views, stages, file formats, stored procedures, and user-defined functions. - Integrate data from multiple sources, including AWS S3 and Glue Catalog, using efficient data formats like Parquet and Iceberg. - Implement and manage data orchestration and workflow automation for data pipelines. - Collaborate with business, analytics, and platform teams to deliver reliable and high-quality data products. - Monitor, troubleshoot, and optimize pipeline performance and cost efficiency. - Adhere to best practices in data governance, security, and CI/CD automation for data environments. - Demonstrate a strong analytical and problem-solving mindset. - Possess excellent communication and collaboration skills. - Ability to work in a fast-paced agile team environment and deliver incremental value. In this role, you will be based out of Pune. Purpose of the role: Your main purpose is to build and maintain systems that collect, store, process, and analyze data, including data pipelines, data warehouses, and data lakes, to ensure accurate, accessible, and secure data. Accountabilities: - Build and maintain data architecture pipelines for the transfer and processing of durable, complete, and consistent data. - Design and implement data warehouses and data lakes to manage appropriate data volumes, velocity, and security measures. - Develop processing and analysis algorithms suitable for the intended data complexity and volumes. - Collaborate with data scientists to build and deploy machine learning models. Analyst Expectations: - Perform activities in a timely and high standard, driving continuous improvement. - Lead, supervise, guide, and support professional development within a team. - Responsible for end results of a team's operational processing and activities. - Take ownership of managing risk and strengthening controls within the work area. - Demonstrate understanding of how areas coordinate and contribute to the organization's objectives. - Resolve problems, guide team members, and communicate complex/sensitive information effectively. - Act as a contact point for stakeholders outside the immediate function and build a network of contacts. As a Barclays colleague, you are expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship, as well as the Barclays Mindset to Empower, Challenge, and Drive.,

As a Big Data Engineer, you will play a crucial role in developing and managing the Big Data solutions for our company. Your responsibilities will include designing and implementing Big Data tools and frameworks, implementing ELT processes, collaborating with development teams, building cloud platforms, and maintaining the production system. Key Responsibilities: - Meet with managers to determine the companys Big Data needs. - Develop Big Data solutions on AWS using tools such as Apache Spark, Databricks, Delta Tables, EMR, Athena, Glue, and Hadoop. - Load disparate data sets and conduct pre-processing services using Athena, Glue, Spark, etc. - Collaborate with software research and development teams. - Build cloud platforms for the development of company applications. - Maintain production systems. Qualifications Required: - 5+ years of experience as a Big Data Engineer. - Proficiency in Python & PySpark. - In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, and AWS data analytics services. - Extensive experience with Delta Tables, JSON, Parquet file format. - Experience with AWS data analytics services like Athena, Glue, Redshift, EMR. - Familiarity with Data warehousing will be a plus. - Knowledge of NoSQL and RDBMS databases. - Good communication skills. - Ability to solve complex data processing and transformation related problems.,

As a Software Data Engineer II at GoDaddy, you will be joining a dynamic team to assist in developing the next-generation Data Integration Platform. This role offers an exciting opportunity to work with modern microservices-based architecture on AWS while also supporting legacy Microsoft-based infrastructure components. **Key Responsibilities:** - Design, build, and maintain reliable and efficient data pipelines. - Collaborate with senior engineers and stakeholders to develop data models supporting key business functions. - Utilize AWS cloud databases and Microsoft SQL Server for data operations. - Integrate diverse datasets using REST APIs and other ingestion tools. - Write clean, maintainable code in languages like Python and C#. - Participate in code reviews, testing, and quality assurance processes to ensure data accuracy and performance. - Troubleshoot data issues and contribute to system reliability and improvement efforts. **Qualifications Required:** - 2+ years of experience as a Data Engineer, Software Engineer, or similar role with strong debugging and problem-solving skills. - Proficiency in programming languages such as C# or Python, along with hands-on experience in SQL and data modeling. - Familiarity with AWS data services (e.g., RDS, S3, Glue, Redshift) and experience with on-premises and cloud database systems. - Experience in integrating data through REST APIs and exposure to big data tools and frameworks. - Understanding of data visualization and reporting tools like Power BI or Tableau. As part of the team, you will enjoy a range of total rewards including paid time off, retirement savings, equity grants, health benefits, and more. GoDaddy values diversity and offers Employee Resource Groups to support a variety of cultures and backgrounds. Whether you have certifications in Microsoft or AWS technologies or an interest in learning and working across both legacy and modern stacks, you are encouraged to apply. GoDaddy is committed to being an equal opportunity employer, providing a supportive environment for all employees. If you have any questions during the application process, feel free to contact the recruiting team at myrecruiter@godaddy.com.,

You will be responsible for: - Designing, developing, and maintaining data pipelines and ETL/ELT workflows using GCP-native tools and services. - Building and optimizing data warehouses using Snowflake. - Writing complex and efficient SQL queries for data transformation, analysis, and reporting. - Collaborating with analysts, data scientists, and business stakeholders to understand data needs and deliver reliable solutions. - Implementing data governance, security, and monitoring best practices across GCP projects. - Tuning queries and optimizing performance of large-scale datasets. - Automating workflows using Cloud Composer (Airflow) or similar orchestration tools. Your Skills & Qualifications should include: - 3+ years of experience in a data engineering or data platform role. - Strong hands-on experience with Snowflake data warehousing. - Expert-level skills in SQL, able to write optimized, scalable, and complex queries. - Experience with data modeling (star/snowflake schema), partitioning, clustering, and performance tuning in a data warehouse. - Familiarity with modern ELT tools such as dbt, Fivetran, or Cloud Data Fusion. - Experience in Python or similar scripting language for data engineering tasks. - Understanding of data governance, privacy, and Google Cloud Platform services, especially BigQuery, Cloud Storage, Dataflow, Pub/Sub, Composer.,

As a Data Engineer at Aptiv, you will play a crucial role in designing, developing, and implementing a cost-effective, scalable, reusable, and secure Ingestion framework. Your responsibilities include working closely with business leaders, stakeholders, and source system SMEs to understand and define business needs, translate them into technical specifications, and ingest data into Google Cloud platform, specifically BigQuery. Additionally, you will be involved in designing and implementing processes for data ingestion, transformation, storage, analysis, modeling, reporting, monitoring, availability, governance, and security of high volumes of structured and unstructured data. **Key Responsibilities:** - Pipeline Design & Implementation: Develop and deploy high-throughput data pipelines using the latest GCP technologies. - Subject Matter Expertise: Serve as a specialist in data engineering and Google Cloud Platform (GCP) data technologies. - Client Communication: Engage with clients, understand their requirements, and translate them into technical data solutions. - Technical Translation: Analyze business requirements, convert them into technical specifications, create source-to-target mappings, enhance ingestion frameworks, and transform data based on business rules. - Data Cataloging: Develop capabilities to support enterprise-wide data cataloging. - Security & Privacy: Design data solutions focusing on security and privacy. - Agile & DataOps: Utilize Agile and DataOps methodologies in project delivery. **Qualifications Required:** - Bachelor's or Master's degree in Computer Science, Data & Analytics, or similar relevant subjects. - 4+ years of hands-on IT experience in a similar role. - Proven expertise in SQL, including subqueries, aggregations, functions, triggers, indexes, database optimization, and relational data-based models. - Deep experience with Google Data Products such as BigQuery, Dataproc, Dataplex, Looker, Data Catalog, Dataflow, and more. - Experience in Qlik Replicate, Spark (Scala/Python/Java), and Kafka. - Excellent written and verbal communication skills to convey technical solutions to business teams. - Knowledge of statistical methods, data modeling, and industry standards in the Data and Analytics space. - Ability to work effectively with globally distributed teams. - Proficiency in designing and creating Tableau/Qlik/Power BI dashboards, Alteryx, and Informatica Data Quality. Furthermore, Aptiv provides an inclusive work environment where individuals can grow and develop, irrespective of gender, ethnicity, or beliefs. Safety is a core value at Aptiv, aiming for a world with Zero fatalities, Zero injuries, and Zero accidents. The company ensures resources and support for your family, physical, and mental health with a competitive health insurance package. **Benefits:** - Personal holidays - Healthcare - Pension - Tax saver scheme - Free Onsite Breakfast - Discounted Corporate Gym Membership In addition to the above benefits, you will have the opportunity for professional growth and development in a multicultural environment, access to internal and external training, coaching, certifications, recognition for innovation and excellence, and convenient transportation options at Grand Canal Dock. If you are passionate about data engineering, Google Cloud Platform, and making a positive impact in the mobility industry, we invite you to join Aptiv's IT Data Analytics team and contribute to our mission of creating a safer, greener, and more connected world.,

As a Data Engineer - Snowflake at Barclays, you will play a crucial role in spearheading the evolution of the infrastructure and deployment pipelines. Your primary focus will be on driving innovation and operational excellence by utilizing cutting-edge technology to build and manage robust, scalable, and secure infrastructure. This will ensure the seamless delivery of digital solutions within the organization. **Key Responsibilities:** - Strong hands-on expertise in Snowflake, encompassing data modeling, SQL, performance tuning, Snowflake objects, and features. - Proficiency in SQL and experience in ETL/ELT development. - Working experience with cloud-based data platforms, particularly AWS. - Familiarity with data formats such as Parquet, Iceberg, and JSON. - Experience with data orchestration tools. - Understanding of data architecture, data warehousing concepts, and agile delivery practices. - Knowledge of Tableau or similar BI tools for downstream consumption. **Qualifications Required:** - Working in an agile delivery model to design, develop, test, and deploy end-to-end data solutions on Snowflake. - Building data pipelines for ingestion, transformation, and consumption of large volumes of structured and semi-structured data. - Designing and implementing data models and data products to support analytical and reporting needs. - Developing and optimizing Snowflake objects like databases, schemas, tables, views, stages, file formats, stored procedures, and user-defined functions. - Integrating data from multiple sources, including AWS S3 and Glue Catalog, leveraging efficient data formats like Parquet and Iceberg. - Implementing and managing data orchestration and workflow automation for data pipelines. - Collaborating with business, analytics, and platform teams to deliver reliable and high-quality data products. - Monitoring, troubleshooting, and optimizing pipeline performance and cost efficiency. - Adhering to best practices in data governance, security, and CI/CD automation for data environments. - Possessing a strong analytical and problem-solving mindset. - Demonstrating excellent communication and collaboration skills. - Ability to work in a fast-paced agile team environment and deliver incremental value. The role is based out of Pune. **Purpose of the role:** The purpose of the Data Engineer - Snowflake role is to build and maintain systems that collect, store, process, and analyze data. This includes data pipelines, data warehouses, and data lakes to ensure that all data is accurate, accessible, and secure. **Additional Details of the Company:** Barclays values of Respect, Integrity, Service, Excellence, and Stewardship are the moral compass guiding all colleagues to do what is right. Additionally, the Barclays Mindset of Empower, Challenge, and Drive serves as the operating manual for behavior within the organization.,

As a Data Engineer and Analyst in the global Engineering Planning and Reporting team at Siemens Energy, your role will involve designing, developing, and maintaining data infrastructure to support the digitalization demands of Compression Engineering and Product Management. You will collaborate with stakeholders to optimize data extraction, transformation, and analysis, develop Power BI reports, and ensure the usability and aesthetic quality of reports and dashboards. Your responsibilities will also include implementing data governance practices, maintaining documentation, and continuously improving the user experience through testing and feedback. Key Responsibilities: - Design, develop, and maintain data infrastructure for a global Engineering organization - Optimize data extraction, transformation, and analysis processes - Develop Power BI reports and ensure usability and aesthetic quality - Implement data governance practices and maintain documentation - Conduct user testing and gather feedback for continuous improvement Qualifications Required: - Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field - 10+ years of experience with business intelligence, data modeling, data warehousing, and ETL processes - Proven experience as a Power BI Developer, including DAX and Power Query - Solid understanding of UI/UX principles and best practices - Excellent problem-solving skills, attention to detail, effective communication, and collaboration skills - Preferred: familiarity with Agile development methodologies and software (e.g., Jira) - Preferred: familiarity with Engineering processes and systems (e.g., SAP, Teamcenter) Siemens Energy's Transformation of Industry division focuses on decarbonizing the industrial sector by enabling the transition to sustainable processes. With a strong industrial customer base, global network, diverse technologies, and integrated capabilities, the division plays a crucial role in driving Siemens Energy's mission forward. Siemens Energy is a global energy technology company with a commitment to developing sustainable and reliable energy systems. With over 100,000 employees in more than 90 countries, the company drives the energy transition and supports one sixth of the world's electricity generation. The company values diversity and inclusion, celebrating the unique contributions of individuals from over 130 nationalities. Siemens Energy provides benefits such as Medical Insurance coverage for all employees, including family members, and options for Meal Cards as part of the compensation package. The company's focus on innovation, decarbonization, and energy transformation creates opportunities for employees to make a difference in the energy sector.,

**Job Description:** As a Data Engineer at GlobalLogic, you will be responsible for connecting Tableau to various data sources for real-time or batch data. You will analyze and interpret complex data to create visualizations that effectively showcase the data. Your role will involve performing and documenting data analysis, data validation, and data mapping/design. Additionally, you will optimize user experience through interactive dashboards, reports, and Tableau story points. You will also assist in the design and development of Tableau visualization solutions and collaborate with stakeholders to understand and prioritize functional requirements. Testing and data quality checks for Tableau Dashboards will be part of your responsibilities, along with maintaining and providing technical support for the company's Tableau environment. **Key Responsibilities:** - Connect Tableau to various data sources for real-time or batch data. - Analyze and interpret complex data to create visualizations. - Perform data analysis, validation, and mapping. - Optimize user experience through interactive dashboards and reports. - Assist in designing and developing Tableau visualization solutions. - Collaborate with stakeholders to prioritize functional requirements. - Perform testing and data quality checks for Tableau Dashboards. - Maintain and provide technical support for the company's Tableau environment. **Qualifications Required:** - Total 8-9 years of experience in Data engineering domain. - 2-3 years of hands-on experience in designing, enhancing, and maintaining ETL jobs using SSIS and SQL. - 3-4 years of experience in designing, developing, and maintaining dashboards and reports in Tableau reporting. - 4-5 years of hands-on experience in building ETL pipelines using Python, lambda, and glue. **About GlobalLogic:** GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world's largest and most forward-thinking companies. Since 2000, GlobalLogic has been at the forefront of the digital revolution, helping create innovative digital products and experiences. GlobalLogic collaborates with clients in transforming businesses and redefining industries through intelligent products, platforms, and services. (Note: The additional details about the company have been omitted as they were not directly related to the job role.),

As a Tableau Data Visualization Lead, you will be responsible for designing, developing, and maintaining interactive dashboards and visual analytics solutions that drive business insights and decision-making. **Job Responsibilities:** - Understanding and performing analysis of source systems data. - Estimation and delivery of adhoc and new Tableau MIS. - Designing and developing advanced & visually compelling Tableau dashboards and visualizations tailored to business needs in the Lending domain. Delivering in data visualization best practices, Tableau BI functionalities, and data storytelling. - Collaborating with business stakeholders to gather requirements and translate them into effective data visualizations. - Optimizing Tableau workbooks for performance and scalability. - Integrating and processing large datasets using Databricks (Spark-based platform). - Building and maintaining data transformation notebooks in Databricks to support reporting and analytics. - Ensuring data quality, consistency, and governance across all visualizations. - Working closely with data engineers, analysts, and business teams to deliver end-to-end BI solutions. - Providing technical leadership and mentorship to junior team members. - Staying updated on industry trends, optimizing performance, and ensuring the usability and scalability of Tableau solutions. - Proactively monitoring, data reconciliation, testing, proper documentation, and troubleshooting of MIS issues. - Ensuring developments follow standard coding patterns and are fully documented for audit submissions. - Ensuring compliance with data governance and data security/masking standards for data delivery. **Competencies for the job:** - Proven experience with Advanced SQL and data transformation for Visualization purposes. - Experience in SQL Query Development (T-SQL or Spark SQL). - 6 to 10 years of experience in data visualization and BI development. - Expert-level proficiency in Tableau including calculated fields, parameters, LOD expressions, Dashboard actions, etc. - 1 to 2 years of hands-on experience in Databricks including notebooks, Delta Lake, Spark SQL, and Python/Scala. - Strong SQL skills and experience working with relational databases. - Experience in the Lending domain with an understanding of loan lifecycle, credit risk, collections, and regulatory reporting. - Familiarity with data modeling, data warehousing concepts, and performance tuning. - Excellent communication and stakeholder management skills. - Experience in advance analytics data modeling and visualization scenarios. **Desired Experience:** - Bachelors or Masters degree in Computer Science, Information Systems, or related field. - Tableau certification is a plus. - Experience with cloud platforms (Azure, AWS, or GCP) is desirable. - Knowledge of Agile methodologies and tools like JIRA. - 5+ years of hands-on experience in Tableau Data Visualization and Data Modeling. - Excellent communication skills in written and verbal English. - Knowledge of core functions of a large NBFC/Bank including Sales, Credit, Collections, Finance, and Accounts.,

As a Data Engineer II at Ethoca, a Mastercard Company, located in Pune, India, you will play a crucial role in driving data enablement and exploring big data solutions within the technology landscape. Your expertise in cutting-edge software development, full stack development, cloud technologies, and data lake experience will be key in working with massive data volumes. Here's an overview of your role: Key Responsibilities: - Design, develop, and optimize batch and real-time data pipelines using Snowflake, Snowpark, Python, and PySpark. - Build data transformation workflows using dbt, focusing on Test-Driven Development (TDD) and modular design. - Implement and manage CI/CD pipelines using GitLab and Jenkins for automated testing, deployment, and monitoring of data workflows. - Deploy and manage Snowflake objects using Schema Change to ensure controlled, auditable, and repeatable releases across environments. - Administer and optimize the Snowflake platform, including performance tuning, access management, cost control, and platform scalability. - Drive DataOps practices by integrating testing, monitoring, versioning, and collaboration throughout the data pipeline lifecycle. - Develop scalable and reusable data models for business analytics and dashboarding in Power BI. - Support real-time data streaming pipelines using technologies like Kafka and Spark Structured Streaming. - Establish data observability practices to monitor data quality, freshness, lineage, and anomaly detection. - Plan and execute deployments, migrations, and upgrades across data platforms and pipelines with minimal service impacts. - Collaborate with stakeholders to understand data requirements and deliver reliable data solutions. - Document pipeline architecture, processes, and standards to ensure consistency and transparency within the team. - Utilize problem-solving and analytical skills to troubleshoot complex data and system issues. - Communicate effectively with technical and non-technical teams. Required Qualifications: - Bachelor's degree in Computer Science/Engineering or related field. - 4-6 years of professional experience in software development/data engineering. - Deep hands-on experience with Snowflake/Data Bricks, Snowpark, Python, and PySpark. - Familiarity with Schema Change, dbt, Java JDK 8, Spring & Springboot framework. - Proficiency in CI/CD tooling (GitLab, Jenkins), cloud-based databases (AWS, Azure, GCP), Power BI, and SQL development. - Experience in real-time data processing, building data observability tools, and executing deployments with minimal disruption. - Strong communication, collaboration, and analytical skills. By joining Ethoca, a Mastercard Company, you will be part of a team committed to building a sustainable world and unlocking priceless possibilities for all. Your contributions as a Data Engineer II will be instrumental in shaping the future of the high growth fintech marketplace.,

As a Senior Data Engineer at our company, your role will involve designing, developing, and maintaining scalable and secure data pipelines to support analytics, reporting, and data integration needs across the organization. **Key Responsibilities:** - Design and develop ETL/ELT processes using IDMC/IICS to integrate data from diverse sources. - Build scalable data pipelines and workflows to support business intelligence and analytics. - Collaborate with data architects and business teams to understand data requirements. - Optimize data transformation logic for performance, reliability, and scalability. - Monitor, troubleshoot, and resolve issues in existing data pipelines. - Ensure data quality, security, and compliance throughout the data lifecycle. - Maintain detailed technical documentation for processes. **Qualifications Required:** - Strong experience with IDMC/IICS and Informatica Cloud Data Integration. - Proficiency in SQL, ETL development, and cloud platforms (AWS, Azure, or GCP). - Solid understanding of data warehousing, data modeling, and data governance. - Experience integrating APIs, flat files, databases, and cloud storage systems. - Familiarity with scheduling, monitoring, and logging tools. - Excellent communication and documentation skills. If you are a highly skilled Senior Data Engineer with hands-on experience in Informatica Intelligent Data Management Cloud (IDMC) and Informatica Intelligent Cloud Services (IICS), and possess the qualifications mentioned above, we encourage you to apply for this exciting opportunity. As a Senior Data Engineer at our company, your role will involve designing, developing, and maintaining scalable and secure data pipelines to support analytics, reporting, and data integration needs across the organization. **Key Responsibilities:** - Design and develop ETL/ELT processes using IDMC/IICS to integrate data from diverse sources. - Build scalable data pipelines and workflows to support business intelligence and analytics. - Collaborate with data architects and business teams to understand data requirements. - Optimize data transformation logic for performance, reliability, and scalability. - Monitor, troubleshoot, and resolve issues in existing data pipelines. - Ensure data quality, security, and compliance throughout the data lifecycle. - Maintain detailed technical documentation for processes. **Qualifications Required:** - Strong experience with IDMC/IICS and Informatica Cloud Data Integration. - Proficiency in SQL, ETL development, and cloud platforms (AWS, Azure, or GCP). - Solid understanding of data warehousing, data modeling, and data governance. - Experience integrating APIs, flat files, databases, and cloud storage systems. - Familiarity with scheduling, monitoring, and logging tools. - Excellent communication and documentation skills. If you are a highly skilled Senior Data Engineer with hands-on experience in Informatica Intelligent Data Management Cloud (IDMC) and Informatica Intelligent Cloud Services (IICS), and possess the qualifications mentioned above, we encourage you to apply for this exciting opportunity.

As a Principal Data Engineer at Brillio, you will play a crucial role in leveraging your expertise in Data Modeling, particularly using tools like ER Studio and ER Win. Your primary responsibility will be to partner closely with clients to deliver physical and logical model solutions, with a focus on Data Lake/ODS, ETL concepts, and modeling structure principles. Your 10+ years of IT experience, including 2+ years in Snowflake, will be instrumental in driving Data Warehousing initiatives, encompassing Dimensions, Facts, and Data modeling. Key Responsibilities: - Collaborate with clients to develop and implement Data Modeling solutions - Utilize ER Studio and other platforms for modeling across large volume-based environments - Lead teams effectively to ensure successful project delivery - Utilize your expertise in Entity Relationship Modeling and Database Designing Administration - Develop SQL queries for investigation and analysis purposes Qualifications Required: - 10+ years of overall IT experience with a focus on Data Modeling - Hands-on experience in Snowflake and ER Studio - Proficiency in Data Warehousing concepts and modeling principles - Strong communication skills and leadership abilities - Knowledge of AWS eco systems is a plus Join Brillio, a rapidly growing digital technology service provider, and be a part of a team that is dedicated to turning disruption into a competitive advantage through innovative digital adoption. Brillio's commitment to providing an exceptional experience to its employees, known as "Brillians", makes it a Great Place to Work certified organization consistently.,