apache kafka jobs in pune, Pune

67 Apache Kafka Jobs in Pune

Toggle to save search
posted 2 weeks ago
experience10 to 14 Yrs
location
Pune, All India
skills
  • Kubernetes
  • Couchbase
  • RabbitMQ
  • Java 17
  • Spring Boot 3xx
  • Service Mesh
  • Caching Hazelcast Apache Ignite
  • Document Databases MongoDB
  • etc
  • EventDriven Design Kafka
  • etc
  • RESTful APIs design
  • development
  • Reactive Programming Project Reactor
  • WebFlux
  • Hibernate JPA
Job Description
As a hands-on Java Architect expert, you will be responsible for designing and building scalable, resilient systems using modern Java technologies. Your key responsibilities will include: - Designing and implementing scalable, secure, and high-performance backend solutions. - Architecting microservices-based applications leveraging Spring Boot 3.x.x and Java 17+. - Providing leadership in implementing service mesh patterns and Kubernetes orchestration. - Defining and implementing caching strategies using Hazelcast or Apache Ignite. - Developing APIs using REST principles and reactive programming paradigms. - Designing solutions around event-driven architecture for real-time processing. - Ensuring best practices in software development, CI/CD, and DevOps. - Collaborating with cross-functional teams including DevOps, QA, and Product Owners. Must-Have Skills: - Java 17+ - Spring Boot 3.x.x - Service Mesh - Kubernetes - Caching (Hazelcast / Apache Ignite) - Document Databases (MongoDB, Couchbase, etc.) - Event-Driven Design (Kafka, RabbitMQ, etc.) - RESTful APIs design and development - Reactive Programming (Project Reactor, WebFlux) - Hibernate / JPA In addition, the company offers: - Leadership & Impact: Drive impactful projects, integrate AI, and leave a mark. - Growth & Learning: Continuous learning, SDLC mastery, career advancement. - Recognition & Excellence: Celebrate dedication, rewards for contributions. - Global Influence: Lead initiatives, reshape financial accessibility worldwide. Benefits: - Work-Life Harmony: Flexible schedules prioritize well-being. - Rewarding Performance: Performance-based bonuses, annual rewards. - Comprehensive Well-being: Provident Fund, health insurance. If interested, please email your resume and cover letter to vinodhini@sunware.in. As a hands-on Java Architect expert, you will be responsible for designing and building scalable, resilient systems using modern Java technologies. Your key responsibilities will include: - Designing and implementing scalable, secure, and high-performance backend solutions. - Architecting microservices-based applications leveraging Spring Boot 3.x.x and Java 17+. - Providing leadership in implementing service mesh patterns and Kubernetes orchestration. - Defining and implementing caching strategies using Hazelcast or Apache Ignite. - Developing APIs using REST principles and reactive programming paradigms. - Designing solutions around event-driven architecture for real-time processing. - Ensuring best practices in software development, CI/CD, and DevOps. - Collaborating with cross-functional teams including DevOps, QA, and Product Owners. Must-Have Skills: - Java 17+ - Spring Boot 3.x.x - Service Mesh - Kubernetes - Caching (Hazelcast / Apache Ignite) - Document Databases (MongoDB, Couchbase, etc.) - Event-Driven Design (Kafka, RabbitMQ, etc.) - RESTful APIs design and development - Reactive Programming (Project Reactor, WebFlux) - Hibernate / JPA In addition, the company offers: - Leadership & Impact: Drive impactful projects, integrate AI, and leave a mark. - Growth & Learning: Continuous learning, SDLC mastery, career advancement. - Recognition & Excellence: Celebrate dedication, rewards for contributions. - Global Influence: Lead initiatives, reshape financial accessibility worldwide. Benefits: - Work-Life Harmony: Flexible schedules prioritize well-being. - Rewarding Performance: Performance-based bonuses, annual rewards. - Comprehensive Well-being: Provident Fund, health insurance. If interested, please email your resume and cover letter to vinodhini@sunware.in.
ACTIVELY HIRING

Top Companies are Hiring in Your City

For Multiple Roles

Jio Platforms Ltd
Jio Platforms Ltdslide-preview-Genpact
posted 2 weeks ago
experience4 to 8 Yrs
location
Pune, All India
skills
  • Java
  • Spring Boot
  • Linux
  • Apache
  • MySQL
  • Redis
  • Kafka
  • Microservices
  • REST
  • AWS
  • Data Structures
  • Message Queues
  • ObjectOriented Design
  • Integration Patterns
  • Complexity Analysis
Job Description
Role Overview: You will be joining Anchanto as an Engineering Manager, where you will lead a team of engineers focused on building and maintaining integrations between Anchanto products and external systems. Your responsibilities will involve driving execution, making technical decisions, ensuring team priorities, promoting best practices, and delivering integrations as scheduled. You will play a crucial role in the current and future integrations of Anchanto products with marketplaces, carriers, and ERP systems while collaborating closely with various teams within the company. Key Responsibilities: - Provide technical leadership for major projects. - Build and manage a team of 15-20 top-notch engineers. - Review and optimize code, guiding engineers in optimization. - Manage business goals, contribute to product strategy, and support team development. - Create clear career paths for team members, offer ongoing mentoring and feedback. - Collaborate with Product Management, Business Development, and Operations for scalable technology solutions. - Architect and implement large-scale, cross-system solutions. - Take full responsibility for the success or failure of engineering initiatives. - Design clean, low-level class architectures with clear responsibilities. - Oversee production deployment and resolve any related issues. - Thrive in a fast-paced, dynamic environment with evolving priorities. Qualifications Required: - Excellent leadership and mentoring skills. - Strong experience with Java, Spring Boot, Linux, Apache, MySQL, Redis, and Kafka. - Proficiency in system design and understanding of distributed systems. - Experience in working with highly transactional and complex systems. - Hands-on expertise in Microservices, REST, and message queues. - Exposure to functional programming and event-driven architectures. - Good understanding of production and cloud environments, especially AWS. - Deep technical experience in object-oriented design, integration patterns, data structures, and complexity analysis. - Minimum 4 years of people management experience. - Experience in a product-based organization is an added advantage. Role Overview: You will be joining Anchanto as an Engineering Manager, where you will lead a team of engineers focused on building and maintaining integrations between Anchanto products and external systems. Your responsibilities will involve driving execution, making technical decisions, ensuring team priorities, promoting best practices, and delivering integrations as scheduled. You will play a crucial role in the current and future integrations of Anchanto products with marketplaces, carriers, and ERP systems while collaborating closely with various teams within the company. Key Responsibilities: - Provide technical leadership for major projects. - Build and manage a team of 15-20 top-notch engineers. - Review and optimize code, guiding engineers in optimization. - Manage business goals, contribute to product strategy, and support team development. - Create clear career paths for team members, offer ongoing mentoring and feedback. - Collaborate with Product Management, Business Development, and Operations for scalable technology solutions. - Architect and implement large-scale, cross-system solutions. - Take full responsibility for the success or failure of engineering initiatives. - Design clean, low-level class architectures with clear responsibilities. - Oversee production deployment and resolve any related issues. - Thrive in a fast-paced, dynamic environment with evolving priorities. Qualifications Required: - Excellent leadership and mentoring skills. - Strong experience with Java, Spring Boot, Linux, Apache, MySQL, Redis, and Kafka. - Proficiency in system design and understanding of distributed systems. - Experience in working with highly transactional and complex systems. - Hands-on expertise in Microservices, REST, and message queues. - Exposure to functional programming and event-driven architectures. - Good understanding of production and cloud environments, especially AWS. - Deep technical experience in object-oriented design, integration patterns, data structures, and complexity analysis. - Minimum 4 years of people management experience. - Experience in a product-based organization is an added advantage.
ACTIVELY HIRING
posted 2 weeks ago
experience4 to 10 Yrs
location
Pune, Maharashtra
skills
  • Big Data
  • Python
  • Java
  • Scala
  • SQL
  • XML
  • Oracle
  • Snowflake
  • MS SQL Server
  • Spark
  • Kafka
  • Git
  • ETL tools
  • Informatica
  • SSIS
  • Data governance
  • AWS
  • Azure
  • GCP
  • SQL
  • Kafka
  • EMR
  • Glue
  • Database design
  • Data warehousing
  • Hadoop
  • Data governance
  • Data quality
  • Data security
  • Data Engineer
  • Databricks
  • MS Notebooks
  • CICD pipelines
  • Apache Airflow
  • Open Lineage
  • Apache Spark Streaming
  • S3
  • Redshift
  • Azure Data FactoryFabric
  • Databricks
  • BigQuery
  • Dataflow
  • Dataproc
  • Data modelling
Job Description
As a Data Pipeline Engineer/ Data Lineage Engineer at Solidatus, your primary responsibility will be to prepare data lineage solutions for clients" existing data pipelines. You will collaborate with cross-functional teams to ensure the integrity, accuracy, and timeliness of data lineage solutions, directly impacting the value clients gain from the product. Your role will involve working closely with clients to help them achieve their contractual goals. **Experience:** - Proven experience as a Data Engineer or in a similar role, with hands-on experience in building and optimizing data pipelines and infrastructure. - Strong problem-solving and analytical skills to diagnose and resolve complex data-related issues. - Solid understanding of data engineering principles and practices. - Excellent communication and collaboration skills to work effectively in cross-functional teams and convey technical concepts to non-technical stakeholders. - Ability to adapt to new technologies and methodologies in a dynamic environment. - Proficiency in programming languages such as Python, Java, Scala, or SQL for data manipulation and scripting. - Experience with Big Data tools and technologies. - Background in software engineering is a plus. **Key Responsibilities:** - Implement robust data lineage solutions that support business intelligence, analytics, and data governance initiatives. - Collaborate with stakeholders to understand data lineage requirements and translate them into technical and business solutions. - Develop and maintain lineage data models, semantic metadata systems, and data dictionaries. - Ensure data quality, security, and compliance with regulations. - Stay updated on emerging technologies and industry trends to enhance data lineage architecture practices. **Qualifications:** - Bachelor's or Master's degree in Computer Science, Information Systems, or a related field. - Proficiency in data modelling, database design, and data warehousing concepts. - Experience with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Hadoop, Spark). - Strong understanding of data governance, data quality, and data security principles. - Excellent communication and interpersonal skills for effective collaboration in a team environment. If you are passionate about data architecture and eager to have a significant impact, Solidatus offers you the opportunity to be part of an innovative company shaping the future of data management. You will collaborate with a dynamic and talented team in a supportive work environment, with opportunities for professional growth and career advancement. Solidatus also provides flexible working arrangements, including hybrid work options, along with a competitive compensation and benefits package. Apply now and join the Solidatus team to contribute to the future of data understanding and management.,
ACTIVELY HIRING
question

Are these jobs relevant for you?

posted 1 month ago
experience5 to 9 Yrs
location
Pune, Maharashtra
skills
  • Python
  • Glue
  • DynamoDB
  • Apache Spark
  • Build Tools
  • TDD
  • Jenkins
  • JSON
  • Avro
  • Kafka
  • BigData
  • AWS development
  • Lambda
  • Step Functions
  • IAM roles
  • Lakeformation
  • EventBridge
  • SNS
  • SQS
  • EC2
  • Security Groups
  • CloudFormation
  • RDS
  • Redshift
  • AWS services
  • Source Control
  • Iceberg
  • Streaming services
  • MSK
  • Kinesis
  • Glue Streaming
  • Data Warehouse
  • Financial services domain
Job Description
As a Data Platform developer at Barclays, you'll play a crucial role in the evolution of the digital landscape, driving innovation and excellence. By harnessing cutting-edge technology, you will revolutionize digital offerings to ensure unparalleled customer experiences. You'll work collaboratively with fellow engineers, business analysts, and stakeholders to deliver technology stacks that meet business requirements and deliver quality solutions. Your role will involve solving complex technical problems that require strong analytical skills and detailed analysis. **Key Responsibilities:** - Hands-on coding experience, preferably in Python - Strong knowledge and hands-on experience of AWS development, including Lambda, Glue, Step Functions, IAM roles, and more - Experience in building efficient data pipelines using Apache Spark and AWS services - Strong technical acumen to troubleshoot issues and apply sound engineering principles - Proven ability to design and develop enterprise-level software solutions - Demonstrable working knowledge of JSON, Iceberg, Avro - Knowledge of streaming services such as Kafka, MSK, Kinesis, Glue Streaming - Effective communication and collaboration with cross-functional teams and stakeholders - Experience in Big Data/Data Warehouse and Financial services domain **Qualifications Required:** - Proven experience with Python coding - Hands-on experience in AWS development - Experience with Apache Spark and building data pipelines - Strong technical acumen and problem-solving skills - Ability to design and develop enterprise-level software solutions - Knowledge of different file formats and streaming services - Excellent communication and collaboration skills - Experience in Big Data/Data Warehouse and Financial services domain Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship, as well as the Barclays Mindset of Empower, Challenge, and Drive, are essential aspects of the company culture that you are expected to embody in your role as a Data Platform developer at Barclays.,
ACTIVELY HIRING
posted 1 month ago
experience8 to 12 Yrs
location
Pune, Maharashtra
skills
  • Core JAVA
  • multithreading
  • data structures
  • Spring boot
  • Apache
  • Spring
  • Hibernate
  • J2EE
  • Design Patterns
  • REST
  • microservices
  • MAVEN
  • JIRA
  • GIT
  • Messaging
  • XML
  • Kafka
  • ORM
  • RDMS
  • Oracle
  • AWS
  • GCP
  • Azure
  • performance tuning
  • SSO
  • Entitlements
  • Session Management
  • communication protocols
  • Agile
  • Scrum
  • Docker
  • Test Driven Development
  • Junit
  • Selenium
  • Load Balances
  • Proxy Servers
  • API Gateways
  • Integration patterns
  • Sybase DB
  • Java Memory Model
Job Description
As an Applications Development Senior Programmer Analyst at Citigroup, your role involves participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your contribution to applications systems analysis and programming activities is crucial for meeting specific business needs or user areas. **Responsibilities:** - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs - Monitor and control all phases of development process including analysis, design, construction, testing, and implementation - Provide user and operational support on applications to business users - Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues and provide evaluation of business process - Recommend and develop security measures in post-implementation analysis - Consult with users/clients and technology groups on issues and recommend advanced programming solutions - Ensure essential procedures are followed and help define operating standards and processes - Serve as advisor or coach to new or lower-level analysts **Qualifications:** - 9-12 years of relevant experience - Experience in systems analysis and programming of software applications - Experience in managing and implementing successful projects - Working knowledge of consulting/project management techniques/methods - Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements - Bachelors degree/University degree or equivalent experience **Additional Details:** Minimum 8+ years of experience in Application Development with Core JAVA, focusing on multithreading and data structures. You should have experience using open-source Java-based frameworks and tools including Spring boot, Apache, Spring, Hibernate, Core Java, J2EE, Design Patterns, programming, and design techniques. Experience with REST, building scalable microservices, deploying microservices using Load Balances, Proxy Servers & API Gateways, MAVEN, JIRA, GIT, CI Tools, Messaging, XML, Integration patterns, Kafka, ORM, RDMS concepts, AWS, GCP or Azure, performance tuning, SSO, Entitlements, Session Management, communication protocols, Agile/Scrum methodologies, containerization using Docker, Test Driven Development (Junit, Selenium, etc.) is preferred. This job description provides a high-level overview of the work performed. Other job-related duties may be assigned as required.,
ACTIVELY HIRING
posted 3 weeks ago
experience10 to 14 Yrs
location
Pune, Maharashtra
skills
  • SQL
  • Data Modeling
  • Spark
  • Kafka
  • Python
  • Scala
  • AWS
  • GCP
  • Azure
  • Data Governance
  • Data Quality
  • Mentoring
  • Data Architecture
  • Retail Analytics
  • Apache Airflow
  • ClickHouse
  • Data Lineage
  • Data Lakehouse
  • eCommerce
  • Digital Marketplaces
  • Data Contracts
  • Semantic Layer Frameworks
  • Opensource Data Tools
Job Description
As a Staff Data Engineer at Pattern, you will play a crucial role in designing and scaling the canonical data model to ensure the delivery of trusted, high-quality data. Your primary focus will be on transforming complex, raw data into easily understandable tables that power analytics, forecasting, and AI/ML applications. With your technical expertise, you will lead the Patterns Data Engineering team by guiding technical direction, mentoring engineers, and establishing a single source of truth that drives Patterns" global growth. **Roles and Responsibilities:** - Design and evolve canonical and medallion-layer data models (bronze/silver/gold) to enable scalable, governed data across the organization. - Build and optimize ETL/ELT pipelines using Apache Airflow, Spark, Trino, and cloud-native tools. - Develop high-performance data marts and semantic layers to meet the analytics and data science requirements. - Architect streaming and analytical systems utilizing Kafka and ClickHouse for real-time and batch insights. - Define and enforce standards for data modeling, documentation, quality, and lineage across all domains. - Collaborate with Analytics, AI/ML, and Infrastructure teams to transform business logic into reusable, trusted data assets. - Mentor engineers, lead design reviews, and drive continuous improvement in scalability and data reliability. - Promote a culture of data clarity, consistency, and craftsmanship, aligning systems with business goals. **Technical Qualifications:** - Bachelors or Masters degree in Computer Science, Data Engineering, or a related field. - 10+ years of experience in Data Engineering, including 2+ years in a senior or staff-level technical role. - Expertise in SQL, data modeling, and data mart design. - Hands-on experience with Apache Airflow, dbt, Spark, Kafka, and ClickHouse. - Proven track record in designing medallion data architectures and scalable data lakehouse solutions. - Proficiency in Python or Scala, and familiarity with AWS, GCP, or Azure data ecosystems. - Strong understanding of data governance, lineage, and quality frameworks. - Ability to mentor engineers and influence architectural strategy across teams. - Experience with real-time or streaming data (Kafka, Kinesis, or Pub/Sub). - Knowledge of data observability and catalog tools (DataHub, Amundsen, Monte Carlo, Great Expectations, or Soda). - Exposure to eCommerce, retail analytics, or digital marketplaces. - Familiarity with governed data contracts and semantic layer frameworks. - Contributions to open-source data tools or engagement in data community initiatives. **Additional Details:** Pattern is a rapidly growing company with immense opportunities for professional development. Joining our team means being part of a dynamic environment with significant room for personal and career growth.,
ACTIVELY HIRING
posted 2 months ago
experience5 to 9 Yrs
location
Pune, Maharashtra
skills
  • Java
  • Spark
  • Spring Boot
  • SQL
  • Kafka
  • Agile Scrum
  • Kanban
  • Gitlab
  • Autosys
  • Devops
  • Micro Services
  • Apache Ignite
  • Cucumber framework
  • React
Job Description
As an Engineer Developer at Barclays, you will be responsible for building, maintaining, and supporting all First line of controls applications. Your key responsibilities will include: - Capturing the functional requirements by communicating with the business team and leads in the US and India. - Converting the functional requirements into design and code efficiently. - Writing regression and unit test cases for the developed functionality. - Coordinating with the L1 support team and proactively engaging in support activities for production if required. - Contributing to the maturity of DevOps on the application. - Providing timely status updates to relevant stakeholders. Qualifications required for this role include: - Graduation in Computer Science & computer application skills. - Proficiency in technologies such as Java 17.0, Spark, Spring Boot, Micro Services, and SQL. - Knowledge of Kafka, Apache Ignite, Cucumber framework, and React would be advantageous. - Awareness of Agile Scrum/Kanban methodology. In addition, the role may involve partnering closely with the business operations team, working with the global team to deliver on agreed outcomes, and experience in Gitlab, Autosys, and DevOps. The purpose of this role is to design, develop, and improve software using various engineering methodologies to provide business, platform, and technology capabilities for customers and colleagues. Accountabilities: - Developing and delivering high-quality software solutions using industry-aligned programming languages, frameworks, and tools. - Collaborating with product managers, designers, and engineers to define software requirements and ensure alignment with business objectives. - Participating in code reviews, promoting a culture of code quality and knowledge sharing. - Staying informed of industry technology trends and contributing to fostering a culture of technical excellence. - Adhering to secure coding practices and implementing effective unit testing practices. As an Assistant Vice President, your expectations will include advising decision-making, contributing to policy development, and leading a team to deliver impactful work. You will be expected to demonstrate leadership behaviours to create an environment for colleagues to thrive and deliver consistently excellent work. All colleagues at Barclays are expected to uphold the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship, as well as demonstrate the Barclays Mindset of Empower, Challenge, and Drive.,
ACTIVELY HIRING
posted 2 months ago
experience5 to 9 Yrs
location
Pune, Maharashtra
skills
  • Apache Spark
  • Data Quality
  • Documentation
  • Spark
  • Hive
  • Solace
  • Kafka
  • Java
  • Scala
  • Spring
  • SQL
  • AWS
  • Glue
  • EMR
  • Business Acumen
  • Strategic Thinking
  • Big Data Technologies
  • Data Processing Systems
  • Data Processing Frameworks
  • Legacy Data Processing Systems
  • Springboot
  • REST APIs
  • Hadoop Ecosystem
  • Financial Services Industry
  • Delta Lake
  • Databricks
  • S3
  • Containerization Technologies
  • Risk
  • Controls
  • Change
  • Transformation
  • Digital
  • Technology
Job Description
As a Senior Spark Data Engineer at Barclays, you will play a crucial role in the evolution of the digital landscape, driving innovation and excellence. Your main responsibilities will include: - Designing, building, and maintaining data processing systems using Apache Spark and related big data technologies. - Ensuring data quality, integrity, and security throughout the data lifecycle. - Developing and maintaining data processing frameworks and reusable components. - Creating and maintaining documentation for data pipelines and processes. - Supporting the migration of legacy data processing systems to modern big data platforms. - Utilizing technologies such as Spark, Hive, Solace, Kafka, Java/Scala, Spring, Springboot, SQL, REST APIs, and having a strong understanding of the Hadoop Ecosystem. Some other highly valued skills for this role include experience in the financial services industry, knowledge of Delta Lake, Databricks, or similar modern data lake technologies, familiarity with AWS, Glue, EMR, S3, and containerization technologies like docker and kubernetes. The purpose of your role will be to build and maintain systems that collect, store, process, and analyze data to ensure accuracy, accessibility, and security. Your key accountabilities will include: - Building and maintaining data architectures pipelines for transferring and processing durable, complete, and consistent data. - Designing and implementing data warehouses and data lakes that manage appropriate data volumes, velocity, and adhere to security measures. - Developing processing and analysis algorithms suitable for the intended data complexity and volumes. - Collaborating with data scientists to build and deploy machine learning models. As an Assistant Vice President in this role, you will be expected to advise and influence decision-making, contribute to policy development, and ensure operational effectiveness. You will collaborate closely with other functions and business divisions and lead a team to deliver impactful work. Additionally, you will be responsible for creating an environment where colleagues can thrive and deliver to an excellent standard. Overall, you will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence, and Stewardship, as well as the Barclays Mindset of Empower, Challenge, and Drive in all your interactions and work.,
ACTIVELY HIRING
posted 2 months ago
experience5 to 9 Yrs
location
Pune, Maharashtra
skills
  • Core Java
  • Spring framework
  • Spring Boot
  • Apache Camel
  • MQ
  • Solace
  • Kafka
  • SQL
  • NoSQL
  • Docker
  • Kubernetes
  • Openshift
  • software design patterns
  • Continuous integration
  • Gitlab
  • BPS
  • IMPACT
  • Apache Ignite
  • Coherence
  • microservices architecture
  • enterprise integration patterns
  • Test Driven
  • Elastic stack
  • Camunda
  • BPM tools
  • Gloss products
Job Description
As a Java Team Lead, you will play a key role in designing and architecting solutions for a strategic trade processing system to communicate with settlement systems. Your primary focus will be on delivering high-quality code that is easy to maintain and can accommodate future enhancements. You will collaborate with business stakeholders to gather requirements for enhancements and build a resilient system to ensure production stability without manual intervention. Additionally, you will provide leadership and review the work done by junior members of the onshore and offshore team. Key Responsibilities: - Design and architect solutions for a strategic trade processing system - Deliver high-quality, maintainable code and incorporate future enhancements - Interact with business stakeholders to gather requirements for enhancements - Build a resilient system for production stability without manual intervention - Provide leadership and review work done by junior team members Qualifications Required: - Core Java experience in server-side multi-threaded applications - Experience with the Spring framework, including Spring Boot - Familiarity with Apache Camel, Messaging technologies like MQ, Solace or Kafka, and Caching technologies like Apache Ignite or Coherence - Proficiency in SQL and NoSQL based database technologies - Working knowledge of cloud technologies including Docker, Kubernetes, and Openshift - Understanding of microservices architecture, software design patterns, and enterprise integration patterns - Familiarity with Test Driven and Continuous Integration software development processes About the Company: The company values technical excellence and innovation, fostering a culture of collaboration and high performance. They emphasize the importance of delivering high-quality software solutions aligned with business objectives. The role is based in the Pune office. Please note that you may be assessed on key critical skills relevant for success in the role, such as risk and controls, change and transformation, business acumen, strategic thinking, digital and technology, and job-specific technical skills.,
ACTIVELY HIRING
posted 2 months ago
experience5 to 9 Yrs
location
Pune, Maharashtra
skills
  • Java
  • Spring Boot
  • JUnit
  • GitLab
  • Maven
  • JIRA
  • Microservices
  • Kafka
  • Requirements Analysis
  • Software Design
  • Collaboration
  • Unit Testing
  • TestDriven Development TDD
  • Continuous Integration CI
  • Container Technologies
  • Apache Ignite
  • Financial Industry Experience
  • Fixed Income Products
  • User Interface UI Design
  • User Experience UX Design
  • Microservices Orchestration
  • BPMN Tools
  • Code Reviews
  • Secure Coding Practices
Job Description
As a Software Engineer - Sales Tech at Barclays, you will be responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality, and governance standards. You will spearhead the evolution of the digital landscape, driving innovation and excellence by harnessing cutting-edge technology to revolutionize digital offerings and ensure unparalleled customer experiences. **Key Responsibilities:** - Proficiency in Java development, with extensive experience in Java (version 8 or higher) - Experience with container technologies, including microservices, messaging protocols like Kafka, and caching technologies such as Apache Ignite - Experience with Spring Boot, JUnit, GitLab/Maven, and JIRA - Solid understanding of Test-Driven Development (TDD) and Continuous Integration (CI) processes - Bachelor's degree in Computer Science or equivalent experience **Qualifications Required:** - Financial industry experience, knowledge of Fixed Income products (Prior experience with Structuring / Pre-Trade / Post-Trade capture, workflow, processing, and associated life-cycling will be a plus) - Proficiency in requirements analysis and software design; Experience investigating production incidents with priority with a view to restore the services ASAP - Basic knowledge of user interface (UI) and user experience (UX) design principles to collaborate effectively with the UI team - Knowledge of microservices orchestration & BPMN tools preferably Camunda - Demonstrated ability to collaborate with diverse individuals and global teams In this role, you will design, develop, and improve software utilizing various engineering methodologies to provide business, platform, and technology capabilities for customers and colleagues. Your accountabilities will include: - Development and delivery of high-quality software solutions by using industry-aligned programming languages, frameworks, and tools while ensuring scalability, maintainability, and optimized performance of the code - Cross-functional collaboration with product managers, designers, and engineers to define software requirements, devise solution strategies, and ensure alignment with business objectives - Participation in code reviews, promotion of a culture of code quality and knowledge sharing, and staying informed of industry technology trends and innovations - Adherence to secure coding practices and implementation of effective unit testing practices to ensure proper code design, readability, and reliability,
ACTIVELY HIRING
posted 2 months ago

Java Architect

Sunware Technologies
experience10 to 14 Yrs
location
Pune, Maharashtra
skills
  • Kubernetes
  • Couchbase
  • RabbitMQ
  • Java 17
  • Spring Boot 3xx
  • Service Mesh
  • Caching Hazelcast Apache Ignite
  • Document Databases MongoDB
  • etc
  • EventDriven Design Kafka
  • etc
  • RESTful APIs design
  • development
  • Reactive Programming Project Reactor
  • WebFlux
  • Hibernate JPA
Job Description
As a hands-on Java Architect expert with over 10 years of experience, you will play a crucial role in designing and building scalable, resilient systems using modern Java technologies. Your strong analytical and problem-solving skills will be put to the test as you tackle the following key responsibilities: - Designing and implementing scalable, secure, and high-performance backend solutions. - Architecting microservices-based applications leveraging Spring Boot 3.x.x and Java 17+. - Providing leadership in implementing service mesh patterns and Kubernetes orchestration. - Defining and implementing caching strategies using Hazelcast or Apache Ignite. - Developing APIs using REST principles and reactive programming paradigms. - Designing solutions around event-driven architecture for real-time processing. - Ensuring best practices in software development, CI/CD, and DevOps. - Collaborating with cross-functional teams including DevOps, QA, and Product Owners. Your must-have skills for this role include proficiency in Java 17+, Spring Boot 3.x.x, Service Mesh, Kubernetes, Caching (Hazelcast / Apache Ignite), Document Databases (MongoDB, Couchbase, etc.), Event-Driven Design (Kafka, RabbitMQ, etc.), RESTful APIs design and development, Reactive Programming (Project Reactor, WebFlux), and Hibernate / JPA. In addition to the technical aspects of the role, you will also have the opportunity to benefit from what the company offers: - Leadership & Impact: Drive impactful projects, integrate AI, and leave a mark. - Growth & Learning: Continuous learning, SDLC mastery, career advancement. - Recognition & Excellence: Celebrate dedication, rewards for contributions. - Global Influence: Lead initiatives, reshape financial accessibility worldwide. The company also provides benefits such as: - Work-Life Harmony: Flexible schedules prioritize well-being. - Rewarding Performance: Performance-based bonuses, annual rewards. - Comprehensive Well-being: Provident Fund, health insurance. If you are interested in this exciting opportunity, please email your resume and cover letter to vinodhini@sunware.in.,
ACTIVELY HIRING
posted 1 month ago
experience2 to 10 Yrs
location
Pune, Maharashtra
skills
  • Java
  • Spring Boot
  • Microservices
  • Kafka
  • PostgreSQL
  • MongoDB
  • Angular
  • HTML
  • CSS
  • RESTful APIs
  • Spring Security
  • Docker
  • Kubernetes
  • GCP
  • AWS
  • Spring Data JPA
  • CICD
  • OAuth2
  • JWT
  • ELK stack
  • Prometheus
  • Grafana
Job Description
As a Senior Full Stack Java Developer at our company, you will be responsible for designing, developing, and maintaining enterprise-grade applications in a dynamic and agile environment. You should have strong expertise in Java, Spring Boot, and Microservices architecture, along with hands-on experience with Kafka, PostgreSQL, MongoDB, Angular, HTML, and CSS. Key Responsibilities: - Design, develop, and maintain Java Spring Boot microservices that are scalable, resilient, and performant - Integrate services with PostgreSQL and MongoDB for structured and unstructured data storage - Develop and maintain Kafka-based event-driven systems for asynchronous processing and data pipelines - Build responsive and dynamic Angular components for user interfaces using HTML, CSS, and TypeScript - Collaborate with DevOps teams for containerization and deployment (Docker/Kubernetes experience is a plus) - Participate in code reviews, design discussions, and technical decision-making - Write unit tests, integration tests, and participate in CI/CD processes - Mentor junior team members and contribute to continuous improvement of engineering practices Qualifications Required: - 5-10 years of experience with Java (8/11/17) and Spring Boot - Strong knowledge of RESTful APIs, Spring Data JPA, and Spring Security - Experience with microservices architecture and distributed systems - Proficient with PostgreSQL (query optimization, schema design) and experience with MongoDB (documents, collections, indexes) - Solid understanding and hands-on experience with Apache Kafka (producers, consumers, topics, partitions) - 2+ years of experience with Angular (10+), proficient in HTML5, CSS3, and TypeScript - Experience with Docker, Kubernetes, or GCP/AWS - Exposure to CI/CD tools such as Jenkins or GitLab CI - Understanding of Agile methodologies (Scrum, Kanban) and knowledge of OAuth2 / JWT for secure API development - Familiarity with ELK stack, Prometheus/Grafana is a plus - Bachelors or Masters degree in Computer Science, Engineering, or related field In addition to the technical qualifications, we are looking for individuals with strong problem-solving and analytical skills, excellent communication and collaboration abilities, self-motivation, ability to work independently and in a team, ownership mindset with attention to quality and detail. If you join our team, you can expect: - Leadership & Impact: Drive impactful projects, integrate AI, and leave a mark - Growth & Learning: Continuous learning, SDLC mastery, career & excellence, celebrate dedication, rewards for contributions - Global Influence: Lead initiatives, reshape financial accessibility worldwide Please note that the information provided is based on the job description available.,
ACTIVELY HIRING
posted 6 days ago
experience10 to 14 Yrs
location
Pune, Maharashtra
skills
  • Java
  • Spring
  • Kafka
  • Microservices
  • Oracle
  • Rest
  • Docker
  • Kubernetes
  • OpenShift
  • Design Patterns
  • Quantitative Analysis
  • Distributed CacheSystems
  • Cloud Native Development
  • Websocket
  • gRPC
  • Enterprise Level Architecture
  • UI Tech Stack
  • Risk
  • Quant Domain
  • Risks Greeks
  • VaRSIMM
Job Description
Role Overview: You will be joining the XVA and Cross Asset Margin technology teams as a Vice President, Application Development Tech Lead Analyst (C13) based in Pune, India. Your main responsibility will be to actively develop and enhance cooperative, strategic systems and services that are regulatory-driven and directly impact how Citi Capital Markets manages risk arising from trading activities. You will support traders, salespeople, risk managers, financial controllers, and operations staff by calculating margin requirements for OTC bilateral derivatives and optimizing margin requirements for clients using models like VaR, SIMM, and Credit Stress. Key Responsibilities: - Provide expertise in area and advanced knowledge of applications programming to ensure application design aligns with the overall architecture blueprint. - Utilize advanced knowledge of system flow to develop standards for coding, testing, debugging, and implementation. - Guide the team to establish design standards, improve efficiency of development workflow, and product rollout. - Take ownership of smooth Production releases planning and execution. - Oversee software quality and system modifications. - Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary. - Analyze existing operations to identify risks and redundancies. - Liaise with team members and management to ensure projects are completed to application development and governance standards. - Keep up-to-date with industry trends and developments. - Resolve a variety of high impact problems/projects through an in-depth evaluation of complex business processes, system processes, and industry standards. - Appropriately assess risk when making business decisions, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients, and assets. Qualifications: - 10+ years of relevant experience in Apps Development role with hands-on coding. - Demonstrated thought leadership in designing complex and distributed systems. - RISK AND QUANT DOMAIN WILL BE ADDED ADVANTAGE. - In-depth knowledge of Java, Spring, Kafka, Distributed Cache/Systems (e.g. Apache Ignite), Microservices, Cloud Native Development. - Hands-on experience with relational databases like Oracle. - API-first design thinking and implementation using Rest, websocket, and gRPC. - Experience with building applications on cloud platforms such as Docker, Kubernetes, or OpenShift. - Proven implementation of design patterns and enterprise-level architecture. - Strong analytical, troubleshooting, and problem-solving skills. - Excellent verbal and written communication skills. - Able to work independently and as part of a team. - Strong organizational and project management skills. - UI tech stack knowledge will be an advantage. - Business knowledge of Risk and Margin and regulatory stress testing is preferred. - Understanding of Risks (Greeks), risk calculation models like VaR/SIMM preferred, and ability to work with Quant team is preferred. Additional Company Details: A full-stack engineer is a high-level software engineer responsible for designing, testing, and implementing various software applications aligned with Citi's strategic goals. They work closely with stakeholders to deliver high-quality software solutions. The role emphasizes continuous learning, collaboration, and adherence to Citi's security policies and procedures.,
ACTIVELY HIRING
posted 1 week ago

Senior DevOps Engineer

PeerLogic Systems
experience5 to 9 Yrs
location
Pune, Maharashtra
skills
  • MySQL
  • bash scripting
  • Python
  • Perl
  • Ruby
  • Kafka
  • wireshark
  • tcpdump
  • Java DevOps
  • Linux platform
  • HA Proxy
  • Zookeeper
  • NGINX configuration
  • init scripts
Job Description
Job Description: As a member of the build and release team, your role involves building, deploying, monitoring, debugging, and proactively fixing issues related to complex Java applications in a Linux environment. Roles and Responsibilities: - Own the build and installation of applications, collaborating with the US team. - Lead and manage a team of engineers locally. - Troubleshoot complex technical problems escalated from QA. - Track bugs and gather specific technical information to assist development team(s). Required Skills: - 5+ years of experience in Java DevOps and Linux platform. - Expertise in setting up Java-based environments, installing, and debugging Java WARs in various run environments such as JBoss, Apache Tomcat, etc. - Strong experience working with MySQL and HA Proxy. - Proficiency in bash scripting and other scripting languages like python, perl, or ruby. - Experience with Kafka, Zookeeper, and NGINX configuration. - Knowledge of init scripts on the Linux platform. - Good debugging, problem-solving, and analytical skills. - Ability to perform network traffic analysis and debugging using tools like wireshark and tcpdump. - Excellent written and verbal communication skills. Preferred Skills: - Familiarity with tools like Chef, Puppet, Nagios, and Cacti. - Working experience with Perforce and JIRA would be advantageous. - Experience in working with open-source projects. Please note that the company details were not provided in the job description.,
ACTIVELY HIRING
posted 2 weeks ago

Backend Lead

Hitachi Careers
experience3 to 7 Yrs
location
Pune, Maharashtra
skills
  • Java
  • Microservices
  • OOPS
  • Maven
  • Jenkins
  • Aerospike
  • Oracle
  • MySQL
  • Springspringboot
  • JPAHibernate
  • MessagingqueueKafkaSQSdistributedmessageSNSJMS
  • NOSQLAerospikeReddisCassendra
  • Core JavaJ2EE
  • SpringStruts
  • Apache Camel OSGI Framework
  • Web Service SOAPREST
  • Caching TechniqueRadis
  • Hazlecast
Job Description
You will be working as a Java Developer at GlobalLogic, located in Pune office with a mandatory requirement of working all 5 days from the office. As a Java Developer, your primary responsibilities will include technical design, implementation, deployment, and support of various systems. You will be expected to partner with Business Analysts to review and implement business requirements, perform development and unit testing, and work closely with the Business team. Additionally, you will be responsible for mentoring and overseeing the development of resources, ensuring compliance with specifications, and contributing to all phases of the development lifecycle. Key Responsibilities: - Technical design, implementation, deployment, and support of systems - Partnering with Business Analysts to review and implement business requirements - Performing development and unit testing, working closely with the Business team - Mentoring and overseeing the development of resources, including reviewing designs and performing code reviews - Ensuring designs are in compliance with specifications - Contributing in all phases of the development lifecycle - Developing high-volume, low-latency applications for mission-critical systems to deliver high-availability and performance - Working on Core Java/J2EE & OOPS concepts - Being well-versed with Spring/Struts & Apache Camel (OSGI Framework) - Having a good understanding of Hibernate and other ORMs - Working on Web Services (SOAP/REST) and Maven build tool such as Jenkins - Implementing Caching Techniques (Redis, Hazelcast, Aerospike) - Having knowledge of databases like Oracle and MySQL Qualifications Required: - B.Tech./MCA, BCA in Computer Science or equivalent - 3-6 years of experience - Must-have skills in Java, Spring/springboot, JPA/Hibernate, Messaging queue (Kafka/SQS/distributed message/SNS/JMS), NOSQL (Aerospike/Redis/Cassandra), and Microservices GlobalLogic is committed to providing a culture of caring where people come first. You will experience an inclusive culture of acceptance and belonging, build meaningful connections with collaborative teammates, and have the opportunity to learn and grow daily. The company offers interesting and meaningful work that allows you to engineer impact for clients worldwide. Additionally, GlobalLogic values balance and flexibility, providing various work arrangements to help you achieve the perfect balance between work and life. Joining GlobalLogic means becoming part of a high-trust organization where integrity is key, and you will be working with a safe, reliable, and ethical global company that values truthfulness, candor, and integrity in everything it does.,
ACTIVELY HIRING
posted 1 month ago
experience6 to 10 Yrs
location
Pune, Maharashtra
skills
  • Snowflake
  • dbt
  • Python
  • SQL
  • Azure Databricks
  • Apache Spark PySpark
  • Azure Data Factory
  • Data Lake
  • CICD tools
  • Gitbased workflows
  • IaC TerraformBicepCloudFormation
Job Description
As an experienced Data Engineer, your role will involve building and optimizing scalable data pipelines, designing modular transformations, ensuring data governance, and enabling analytics across lakehouse and warehouse architectures. You will need to operate in multi-cloud environments, apply engineering best practices, and collaborate with cross-functional teams to deliver high-quality, governed, and production-ready data solutions. **Key Responsibilities:** - Design and implement ETL/ELT pipelines using Azure Databricks (PySpark, SQL, Delta Lake) or Snowflake (SQL, dbt). - Build metadata-driven ingestion frameworks to integrate data from relational databases, APIs, and flat files (CSV, JSON, Parquet). - Develop and manage Bronze, Silver, Gold layers in ADLS Gen2 and Snowflake for analytics and reporting. - Apply dbt Core/Cloud for modular data transformations, lineage tracking, and data quality testing. - Write Python scripts for automation, orchestration, and API-based integrations. - Develop optimized, scalable SQL queries to handle large, complex datasets. - Support dimensional modeling, data marts, and curated datasets for BI, AI/ML, and self-service analytics. - Apply performance tuning (partitioning, caching, indexing) in both Databricks and Snowflake environments. - Implement Unity Catalog (Databricks) and Snowflake's RBAC/ABAC for data access control and lineage. - Secure data assets using Azure AD, Key Vault, role-based policies, and encryption standards. - Contribute to data governance, quality, and compliance frameworks (GDPR, HIPAA, SOC2). - Build and maintain CI/CD pipelines for Databricks notebooks, ADF pipelines, dbt projects, and Snowflake workloads using Azure DevOps or GitHub. - Apply Git workflows for version control and automated deployments. - Use Infrastructure-as-Code (Terraform, Bicep, CloudFormation) for provisioning and automation. - Monitor data pipeline performance, implement observability, and optimize for cost efficiency. - Work across Azure (ADF, Databricks, ADLS) or Snowflake/dbt (on AWS or multi-cloud). - Integrate external tools such as Airflow, Fivetran, or Nifi for orchestration and ingestion. - Exposure to real-time streaming frameworks (Kafka, Spark Structured Streaming, EventHub/Kinesis) is a plus. **Required Skills & Qualifications:** - 6-10 years of hands-on data engineering experience. - Strong expertise in Azure Databricks, Apache Spark (PySpark), Delta Lake, ADF, Snowflake, and dbt. - Proficiency in Python for scripting, automation, and integrations. - Strong SQL skills and knowledge of data lakehouse and data warehouse principles. - Hands-on experience with CI/CD tools, Git-based workflows, and IaC. - Experience with structured, semi-structured, and unstructured data. **Nice-to-Have Skills:** - Experience with Delta Live Tables (DLT), Delta Sharing, or Unity Catalog. - Familiarity with Azure Synapse Analytics, AWS Redshift, or GCP BigQuery. - Experience with real-time streaming (Kafka, EventHub, Spark Streaming). - Familiarity with data governance tools. - Understanding of MLOps or ML collaboration workflows. **Soft Skills:** - Strong communication and collaboration skills. - Proactive, detail-oriented, with strong documentation practices. - Ability to thrive in fast-paced, evolving environments. - Problem-solving mindset with a business-first approach.,
ACTIVELY HIRING
posted 3 weeks ago
experience10 to 14 Yrs
location
Pune, Maharashtra
skills
  • agile methodologies
  • data
  • analytics
  • power bi
  • python
  • design
  • tableau
  • platforms
  • architecture
  • r
  • kafka
  • data architecture
  • predictive analytics
  • sql
  • data visualization
  • data governance
  • azure
  • database design
  • jira
  • hadoop
  • confluence
  • leadership
  • aws
  • cloud platforms
  • projects
  • machine learning frameworks
  • looker
  • etl processes
  • big data technologies
  • skills
Job Description
Role Overview: You will be responsible for leading the data analytics team as a Data Analyst Architect, with a focus on designing and optimizing data solutions, providing technical guidance, and managing a team to deliver high-impact data-driven projects. Your role will involve deep understanding of data systems, extensive experience in analytics architecture, and proven leadership skills. Key Responsibilities: - Design scalable and efficient data architectures to support analytics and business intelligence needs. - Establish and maintain data governance standards, ensuring data quality, security, and compliance. - Lead the development and delivery of actionable insights from complex datasets. - Collaborate with stakeholders to understand business goals and translate them into data-driven solutions. - Manage, mentor, and inspire a team of data analysts and engineers. - Foster a culture of excellence, innovation, and continuous improvement within the team. - Stay updated with emerging trends and technologies in data analytics and architecture. - Guide the adoption and integration of modern tools (e.g., Power BI, Tableau, Apache Spark, Snowflake, AWS, Azure) to enhance analytics capabilities. - Oversee end-to-end project lifecycles, ensuring timely and quality deliverables. - Identify risks and develop mitigation strategies to keep projects on track. - Partner with cross-functional teams to align analytics architecture with organizational strategies. - Present findings and recommendations to executives and other key stakeholders. Qualifications Required: - Bachelors or Masters degree in Computer Science, Data Science, Information Systems, or a related field. - Minimum 10+ years of experience in data analytics, architecture, and team leadership. - Expertise in data modeling, ETL processes, and database design. - Proficiency in SQL, Python, R, and other analytical tools. - Experience with big data technologies (e.g., Hadoop, Spark, Kafka). - Strong understanding of data visualization platforms (e.g., Tableau, Power BI, Looker). - Knowledge of cloud platforms and services (AWS, Azure, GCP). - Familiarity with machine learning frameworks and predictive analytics. - Proven experience managing and mentoring teams, with strong interpersonal and communication abilities. - Excellent analytical and critical-thinking skills, with a strategic mindset.,
ACTIVELY HIRING
posted 3 weeks ago
experience3 to 7 Yrs
location
Pune, All India
skills
  • Weblogic
  • OHS
  • MQ
  • Solace
  • SFTP
  • CyberArk
  • Autosys
  • ServiceNow
  • Change Management
  • NDM
  • KAFKA
  • Platform Infrastructure
  • AHS
  • EMS
  • Unix commands
Job Description
As an experienced Platform Infrastructure professional with over 2.5 years of experience, you will be responsible for the following key areas: - Hands-on experience with Weblogic, OHS (Oracle HTTP Server), and AHS (Apache HTTP Server) for application deployment and maintenance. - Skilled in working with middleware services such as EMS, MQ, Solace, and SFTP. - Proficient in CyberArk for secure access management and Autosys for job scheduling and automation. - Coordinating with PROD Support to complete the Infra Releases. - Hands-on experience in Unix commands. - Experience in Service-Now and change Management. Optionally, you should be ready to handle development work as an individual contributor, be skilled in working with middleware services such as NDM, and possess knowledge of KAFKA. About Virtusa: When you join Virtusa, you become part of a team of 27,000 professionals globally who prioritize teamwork, quality of life, and professional and personal development. We are committed to providing you with exciting projects, opportunities, and exposure to state-of-the-art technologies throughout your career with us. At Virtusa, collaboration and a team-oriented environment are highly valued, creating a dynamic space where great minds can nurture new ideas and achieve excellence. As an experienced Platform Infrastructure professional with over 2.5 years of experience, you will be responsible for the following key areas: - Hands-on experience with Weblogic, OHS (Oracle HTTP Server), and AHS (Apache HTTP Server) for application deployment and maintenance. - Skilled in working with middleware services such as EMS, MQ, Solace, and SFTP. - Proficient in CyberArk for secure access management and Autosys for job scheduling and automation. - Coordinating with PROD Support to complete the Infra Releases. - Hands-on experience in Unix commands. - Experience in Service-Now and change Management. Optionally, you should be ready to handle development work as an individual contributor, be skilled in working with middleware services such as NDM, and possess knowledge of KAFKA. About Virtusa: When you join Virtusa, you become part of a team of 27,000 professionals globally who prioritize teamwork, quality of life, and professional and personal development. We are committed to providing you with exciting projects, opportunities, and exposure to state-of-the-art technologies throughout your career with us. At Virtusa, collaboration and a team-oriented environment are highly valued, creating a dynamic space where great minds can nurture new ideas and achieve excellence.
ACTIVELY HIRING
posted 2 months ago

Data Engineer - Mid

Systems Plus Pvt
experience6 to 10 Yrs
location
Pune, Maharashtra
skills
  • Snowflake
  • dbt
  • Python
  • SQL
  • Azure Databricks
  • Apache Spark PySpark
  • Azure Data Factory
  • Data Lake
  • CICD tools
  • Gitbased workflows
  • IaC TerraformBicepCloudFormation
Job Description
As a Senior Data Engineer based in Pune, you will play a crucial role in building and optimizing scalable data pipelines, designing modular transformations, ensuring data governance, and enabling analytics across lakehouse and warehouse architectures. Your expertise in Azure Databricks, Apache Spark (PySpark), Azure Data Factory, Data Lake, Snowflake, and dbt will be key to your success in this role. **Key Responsibilities:** - **Data Engineering & Pipeline Development** - Design and implement ETL/ELT pipelines using Azure Databricks (PySpark, SQL, Delta Lake) or Snowflake (SQL, dbt). - Build metadata-driven ingestion frameworks to integrate data from relational databases, APIs, and flat files (CSV, JSON, Parquet). - Develop and manage Bronze, Silver, Gold layers in ADLS Gen2 and Snowflake for analytics and reporting. - Apply dbt Core/Cloud for modular data transformations, lineage tracking, and data quality testing. - Write Python scripts for automation, orchestration, and API-based integrations. - **SQL Development & Data Modeling** - Develop optimized, scalable SQL queries to handle large, complex datasets. - Support dimensional modeling, data marts, and curated datasets for BI, AI/ML, and self-service analytics. - Apply performance tuning (partitioning, caching, indexing) in both Databricks and Snowflake environments. - **Governance, Security & Compliance** - Implement Unity Catalog (Databricks) and Snowflake's RBAC/ABAC for data access control and lineage. - Secure data assets using Azure AD, Key Vault, role-based policies, and encryption standards. - Contribute to data governance, quality, and compliance frameworks (GDPR, HIPAA, SOC2). - **DevOps & Automation** - Build and maintain CI/CD pipelines for Databricks notebooks, ADF pipelines, dbt projects, and Snowflake workloads using Azure DevOps or GitHub. - Apply Git workflows for version control and automated deployments. - Use Infrastructure-as-Code (Terraform, Bicep, CloudFormation) for provisioning and automation. - Monitor data pipeline performance, implement observability, and optimize for cost efficiency. - **Cloud & Ecosystem Integration** - Work across Azure (ADF, Databricks, ADLS) or Snowflake/dbt (on AWS or multi-cloud). - Integrate external tools such as Airflow, Fivetran, or Nifi for orchestration and ingestion. - Exposure to real-time streaming frameworks (Kafka, Spark Structured Streaming, EventHub/Kinesis) is a plus. **Required Skills & Qualifications:** - 6-10 years of hands-on data engineering experience. - Strong expertise in Azure Databricks, Apache Spark (PySpark), Delta Lake, ADF, Snowflake, and dbt. - Proficiency in Python for scripting, automation, and integrations. - Strong SQL skills with experience in window functions, CTEs, and performance tuning. - Solid knowledge of data lakehouse and data warehouse principles. - Hands-on experience with CI/CD tools, Git-based workflows, and IaC. - Experience working with structured, semi-structured, and unstructured data. **Nice-to-Have Skills:** - Experience with Delta Live Tables (DLT), Delta Sharing, or Unity Catalog. - Familiarity with Azure Synapse Analytics, AWS Redshift, or GCP BigQuery. - Experience with real-time streaming technologies. - Familiarity with data governance tools. - Understanding of MLOps or ML collaboration workflows. **Soft Skills:** - Strong communication and collaboration skills. - Proactive, detail-oriented, and strong documentation practices. - Ability to thrive in fast-paced, evolving environments. - Problem-solving mindset with a business-first approach.,
ACTIVELY HIRING
posted 2 months ago
experience10 to 14 Yrs
location
Pune, Maharashtra
skills
  • Java
  • Spring
  • Kafka
  • Microservices
  • Oracle
  • Rest
  • Docker
  • Kubernetes
  • OpenShift
  • Design Patterns
  • Distributed CacheSystems
  • Cloud Native Development
  • Websocket
  • gRPC
  • Enterpriselevel Architecture
  • UI tech stack
  • Risk
  • Margin
  • Regulatory Stress Testing
Job Description
You are now seeking a high-caliber professional to join the team as a Vice President, Application Development Tech Lead Analyst based in Pune, India. The XVA and Cross Asset Margin technology teams actively develop and enhance a set of cooperative, strategic systems and services that are regulatory-driven, impacting how Citi Capital Markets manages risk. Your responsibility will involve calculating margin requirements for OTC bilateral derivatives and optimizing margin requirements for clients by considering offsets across various financial products using models like VaR, SIMM, and Credit Stress. Your support will be extended to traders, salespeople, risk managers, financial controllers, and operations staff. - Lead applications systems analysis, design, and programming activities. - Establish design standards and improve the efficiency of development workflows and product rollout. - Take ownership of smooth Production releases planning and execution. - Oversee software quality and system modifications. - Serve as an advisor or coach to mid-level developers and analysts. - Analyze existing operations to identify risks and redundancies. - Conduct comprehensive assessments to develop solutions. - Keep up-to-date with industry trends and developments. In terms of qualifications, you should have: - 10+ years of relevant experience in an Apps Development role with hands-on coding. - Demonstrated thought leadership in designing complex and distributed systems. - In-depth knowledge of Java, Spring, Kafka, Distributed Cache/Systems (e.g. Apache Ignite), Microservices, Cloud Native Development, and relational databases like Oracle. - Experience with API first design thinking and implementation using Rest, websocket, and gRPC. - Building applications on cloud platforms such as Docker, Kubernetes, or OpenShift. - Implementing design patterns and enterprise-level architecture. - Strong analytical, troubleshooting, problem-solving, verbal and written communication skills. - Ability to work independently and as part of a team, multitask, and prioritize tasks effectively. - Strong organizational and project management skills. - UI tech stack knowledge. - Business knowledge of Risk and Margin and regulatory stress testing. - Bachelors in Computer Science, Mathematics, or equivalent is required, with a Masters degree preferred.,
ACTIVELY HIRING
logo

@ 2025 Shine.com | All Right Reserved

Connect with us:
  • LinkedIn
  • Instagram
  • Facebook
  • YouTube
  • Twitter