bigquery-jobs

622 Bigquery Jobs

Toggle to save search
posted 1 week ago
experience10 to 20 Yrs
Salary6 - 14 LPA
location
Hyderabad
skills
  • gcp
  • ansible
  • fusion
  • data engineering
  • data
  • sql
  • bigquery
Job Description
Job ID: ITC/G/20251029/22301 Role: GCP Data Engineer Location: Hyderabad Status: Open   Role Overview This role focuses on designing, developing, testing, and deploying data models and transformations on Google Cloud Platform, primarily using BigQuery and Data Fusion. The engineer will be responsible for building scalable data pipelines, optimizing data structures for analytics and visualization, and supporting CI/CD automation. Key Responsibilities Design and develop GCP-based data models and ETL/ELT pipelines. Build and deploy transformations in BigQuery and Data Fusion. Optimize data views and datasets for reporting and visualization use cases. Manage and maintain code repositories, artifacts, and deployment workflows. Implement CI/CD pipelines using tools like Git, Jenkins, Ansible, etc. Perform data preparation, wrangling, and quality checks. Work with relational, dimensional, and preferably Data Vault data models. Collaborate in a hybrid work environment with cross-functional teams. Required Skills Google Cloud Platform (GCP) BigQuery Data Fusion SQL / T-SQL Ansible CI/CD Tools (Git, Jenkins) Data Modeling (Relational, Dimensional; Data Vault preferred) Data Wrangling & Preparation Qualification B.Tech (Computer Science, IT, or related field preferred) Experience 6-15 years in Data Engineering / Cloud Data Platforms Salary Range 10,00,000 - 27,00,000 (based on experience and skill level)
INTERVIEW ASSURED IN 15 MINS

Top Companies are Hiring in Your City

For Multiple Roles

Jio Platforms Ltd
Jio Platforms Ltdslide-preview-Genpact
posted 1 week ago

GCP Data Engineer

Hucon Solutions India Pvt.Ltd.
Hucon Solutions India Pvt.Ltd.
experience5 to 9 Yrs
Salary10 - 20 LPA
location
Bangalore, Kochi+2

Kochi, Chennai, Hyderabad

skills
  • devops
  • gcp
  • python
  • etl
  • docker
  • kubernates
  • bigquery
  • terraform
  • dataflow
Job Description
Job Title: GCP Data Engineer Employment Type: Permanent Industry of the Employer: IT / Software Services Department / Functional Area: Data Engineering, Cloud Engineering Job Description GREETINGS FROM HUCON Solutions Hiring for Leading MNC GCP Data Engineer Role: GCP Data Engineer Skills: GCP, Python, SQL, BigQuery, ETL Data Pipeline Experience: 59 Years Locations: Chennai, Kochi, Bangalore, Hyderabad, Pune Eligibility Criteria Strong hands-on experience in Python, Pandas, NumPy Expertise in SQL and solid understanding of Data Warehousing concepts In-depth knowledge of GCP Services including: BigQuery, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions Experience with Docker, Kubernetes, GitHub Strong communication and analytical skills Working experience with PySpark, Data Modeling, Dataproc, Terraform Google Cloud Professional Data Engineer certification is highly preferred Role Responsibilities Design, develop, and manage robust and scalable ETL / ELT pipelines on GCP using Dataflow, Cloud Run, BigQuery, Pub/Sub, and Cloud Composer Implement data ingestion workflows for structured and unstructured data sources Build and maintain data warehouses and data lakes using BigQuery, Cloud Storage, and other GCP tools Work with data modeling, architecture, and ETL/ELT frameworks Ensure best practices in performance, optimization, and cloud data management Keywords / Skills GCP, Python, SQL, BigQuery, ETL, Data Pipeline, Data Engineering, Cloud Run, Pub/Sub, Cloud Storage, Dataproc, Terraform, Kubernetes, Docker, Dataflow Total Experience: 5 to 9 Years Salary Type: Yearly Annual Salary Offered: As per company standards Job Type: Full Time Shift Type: Day Shift / Rotational (based on project requirement) Location of the Job: Chennai | Kochi | Bangalore | Hyderabad | Pune
INTERVIEW ASSURED IN 15 MINS
posted 5 days ago
experience10 to 15 Yrs
location
All India
skills
  • Data Modeling
  • DBT
  • SQL
  • Snowflake
  • Data Governance
  • AWS
  • Azure
  • GCP
  • BI Tools
  • Git
  • Agile Development
  • ETL Design
  • Ecom
  • Order Supply Chain Management
  • Redshift
  • BigQuery
  • Data Lineage
  • Data Quality Frameworks
  • CICD
Job Description
As a highly experienced Data Modeler/ETL Architect with expertise in data modeling, ETL design, and DBT frameworks, your role will involve designing, implementing, and optimizing scalable data models, pipelines, and data architecture to support enterprise-level analytics and data warehouse solutions. - Design and maintain conceptual, logical, and physical data models for enterprise data platforms. - Lead the architecture, development, and optimization of ETL/ELT workflows using DBT, SQL, and modern data integration tools. - Define and implement data modeling standards, best practices, and governance frameworks. - Collaborate with data engineers, analysts, and business stakeholders to translate requirements into robust data solutions. - Architect data pipelines ensuring data quality, integrity, and consistency across multiple systems. - Optimize data models for performance, scalability, and reusability in analytical workloads (Snowflake, Redshift, BigQuery, etc.). - Oversee data lineage, metadata management, and documentation for transparency and maintainability. - Provide technical leadership and mentorship to data engineers and analysts in data modeling and DBT development. - Participate in data architecture reviews, performance tuning, and troubleshooting. Qualifications: - 10+ years of experience in data engineering, data modeling, or data architecture. - Expertise in ETL/ELT design and architecture using modern data integration platforms. - Proficiency in SQL and experience with cloud data warehouses (e.g., Snowflake, Redshift, BigQuery, Azure Synapse). - Hands-on experience with data modeling techniques (3NF, star schema, data vault, dimensional modeling). - Solid understanding of data governance, data lineage, and data quality frameworks. - Experience in cloud platforms (AWS, Azure, or GCP). - Understanding of business intelligence (BI) and analytics tools such as Looker, Power BI, or Tableau. - Familiarity with version control (Git), CI/CD for data pipelines, and agile development practices. - Strong problem-solving, analytical, and communication skills. Please note that the company details were not provided in the job description.,
ACTIVELY HIRING
question

Are these jobs relevant for you?

posted 2 weeks ago
experience8 to 12 Yrs
location
Bangalore, Karnataka
skills
  • Java
  • Python
  • Go
  • Scala
  • Apache Spark
  • CC
  • Apache Hive
  • Apache Iceberg
Job Description
Role Overview: In this role, you will be working on solving problems and designing solutions that facilitate data migrations on a large scale, from petabytes to exabytes per day. Your main focus will be to accelerate customers" journey towards Business Intelligence (BI) and Artificial Intelligence (AI) by delivering multiple products to external Google Cloud Platform (GCP) customers. Your work will involve simplifying data processing needs and delivering enterprise-grade solutions using cutting-edge technology and tools. Key Responsibilities: - Design and develop software for Data Warehouse migration, with a focus on cloud-native and distributed systems. - Collaborate with Product and Engineering Managers to define the technical strategy for data migration and develop new connectors. - Provide technical guidance and mentorship to the team, ensuring quality in design and code reviews. - Take ownership of delivering new features, manage project priorities, and meet deadlines for a high-quality launch. - Engage with cross-functional partners, including Google Cloud Platform (GCP) infrastructure teams, to create and deliver integrated solutions. Qualifications Required: - Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience. - 8 years of experience in software development in one or more general-purpose programming languages. - Experience in one or more programming languages such as Java, C/C++, Python, or Go. - Experience in systems engineering, designing and building distributed processing systems using languages like Java, Python, or Scala. - Experience in data warehouse design, developing and managing enterprise data warehouse solutions. - Experience in data analytics, leveraging data systems to provide insights and collaborate in business decisions. - Familiarity with modern Open Source Technologies in the big data ecosystem, including frameworks like Apache Spark, Apache Hive, and Apache Iceberg.,
ACTIVELY HIRING
posted 2 months ago

GCP Bigquery

LTIMindtree
experience4 to 8 Yrs
location
Maharashtra, Pune
skills
  • SQL
  • Python
  • GCP Bigquery
  • Dataflow
Job Description
As a GCP Data Engineer at our company, you will play a crucial role in implementing data solutions using Google Cloud Platform (GCP) tools and programming languages like SQL and Python. Your responsibilities will include working on data pipelines, transformation logics, and data models for implementation projects. Here is a breakdown of the key aspects of this role: **Role Overview:** With over 5 years of experience in data projects, your main focus will be on GCP BigQuery, SQL, and Python dataflow skills. You will be involved in building data pipelines, transformation logics, and data models for implementation projects. **Key Responsibilities:** - Implement data solutions using GCP and be proficient in SQL and Python programming. - Ensure clarity on non-functional requirements and implement them effectively. - Collaborate with the Client Technical Manager to understand the customer's landscape and IT priorities. - Lead performance engineering and capacity planning exercises for databases. - Implement data pipelines for Data Analytics solutions using Google Cloud Data Flow, Apache Beam, and Java programming. - Experience in working with RDBMS, NoSQL databases, and deploying Big data applications with GCP Big Data Services. - Familiarity with different development methodologies such as RUP, Scrum, and XP. **Qualification Required:** - Bachelor of Engineering in any discipline or equivalent. - 4 years of experience in implementing data solutions using GCP BigQuery and SQL programming. - Proficiency in dealing with data access layer, RDBMS, NoSQL, and Big Data applications with GCP Services. - Good to have SQL skills and experience with diverse stakeholders. - Excellent articulation, communication, and presentation skills. - Strong problem-solving skills, a learning attitude, and a team player mentality. This role requires mandatory skills in GCP Storage, GCP BigQuery, GCP DataProc, GCP Cloud Composer, Apache Airflow, Java, Python, Scala, GCP Datastream, Google Analytics Hub, GCP Workflows, GCP Dataform, GCP Datafusion, GCP Pub/Sub, ANSI-SQL, GCP Dataflow, GCP Cloud Pub/Sub, and Big Data Hadoop Ecosystem. Join us and be a part of our innovative data projects using cutting-edge technologies.,
ACTIVELY HIRING
posted 2 months ago
experience5 to 9 Yrs
location
Hyderabad, Telangana
skills
  • Google Cloud Platform
  • Data Modeling
  • Machine Learning
  • Python
  • Java
  • Scala
  • SQL
  • Query Optimization
  • Distributed Computing
  • Analytical Skills
  • Communication Skills
  • Team Collaboration
  • Project Management
  • Data Governance
  • Compliance
  • Security
  • Data Visualization
  • Dataflow
  • BigQuery
  • ETL processes
  • Big Data Workloads
  • Data Processing Frameworks
  • ProblemSolving Skills
Job Description
As an AIML Architect specializing in Dataflow and BigQuery, you play a crucial role in the organization by designing, implementing, and optimizing data architectures within Google Cloud's BigQuery environment. Your expertise in advanced data analytics, artificial intelligence, and machine learning enables you to create efficient data models that enhance decision-making processes across various departments. Collaborating with data engineers, data scientists, and application developers, you align technical solutions with business goals to drive innovation and efficiency. Key Responsibilities: - Design and architect data processing solutions using Google Cloud BigQuery and Dataflow. - Develop data pipeline frameworks supporting batch and real-time analytics. - Implement machine learning algorithms for extracting insights from large datasets. - Optimize data storage and retrieval processes to improve performance. - Collaborate with data scientists to build scalable models. - Ensure data quality and integrity throughout the data lifecycle. - Work closely with cross-functional teams to align data workflows with business objectives. - Conduct technical evaluations of new tools and technologies. - Manage large-scale data migrations to cloud environments. - Document architecture designs and maintain technical specifications. - Provide mentorship to junior data engineers and analysts. - Stay updated on industry trends in cloud computing and data engineering. - Design and implement security best practices for data access and storage. - Monitor and troubleshoot data pipeline performance issues. - Conduct training sessions on BigQuery best practices for team members. Required Qualifications: - Bachelor's or Master's degree in Computer Science, Data Science, or related field. - 5+ years of experience in data architecture and engineering. - Proficiency in Google Cloud Platform, especially BigQuery and Dataflow. - Strong understanding of data modeling and ETL processes. - Experience in implementing machine learning solutions in cloud environments. - Solid programming skills in Python, Java, or Scala. - Expertise in SQL and query optimization techniques. - Experience with big data workloads and distributed computing. - Familiarity with modern data processing frameworks and tools. - Strong analytical and problem-solving skills. - Excellent communication and team collaboration abilities. - Proven track record of managing comprehensive projects. - Ability to work in a fast-paced, agile environment. - Understanding of data governance, compliance, and security. - Experience with data visualization tools is a plus. - Certifications in Google Cloud or relevant technologies are advantageous.,
ACTIVELY HIRING
posted 2 days ago

GCP Big query Developer

NTT DATA North America
experience5 to 9 Yrs
location
Hyderabad, Telangana
skills
  • SQL
  • Linux
  • ETL Experience
  • Google Cloud Platform BigQuery
  • Cloud Run
  • Cloud Functions
Job Description
As a GCP BigQuery Developer at NTT DATA, you will be joining our team in Hyderabad, Telangana (IN-TG), India (IN) where you will have the opportunity to work with a global company that values innovation, excellence, and inclusivity. **Role Overview:** You will be responsible for developing applications on Google Cloud Platform (GCP) with a focus on BigQuery. Your role will require mandatory skills in ETL Experience, Google Cloud Platform BigQuery, SQL, and Linux. Additionally, experience with Cloud Run and Cloud Functions would be desirable. **Key Responsibilities:** - Develop applications on GCP utilizing BigQuery - Utilize ETL Experience, SQL, and Linux skills for application development - Optional experience or conceptual understanding of Cloud Run and Cloud Functions **Qualifications Required:** - Strong hands-on experience in Linux and SQL - Optional experience or conceptual understanding of GCP BigQuery **About NTT DATA:** NTT DATA is a global leader in business and technology services with a value of $30 billion. We cater to 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success. With a diverse team of experts in over 50 countries and a strong partner ecosystem, we offer a wide range of services including business and technology consulting, data and artificial intelligence solutions, and industry-specific services. As part of the NTT Group, we are dedicated to investing in research and development to drive the digital future. Learn more about us at us.nttdata.com.,
ACTIVELY HIRING
posted 1 day ago
experience3 to 7 Yrs
location
Maharashtra, Pune
skills
  • SQL
  • Python
  • Java
  • Scala
  • Google Cloud Platform
  • Airflow
  • dbt
  • Data modeling
  • Data governance
  • ETLELT frameworks
  • Cloud Composer
  • OLAP concepts
  • Streamingbatch data ingestion
  • BigQuery ML
  • BIvisualization tools
Job Description
As a Data Engineer at DataNimbus, you will play a crucial role in designing, developing, and maintaining a highly scalable data warehouse solution in BigQuery. Your responsibilities will include: - Designing data models, schemas, and partitioning strategies to ensure efficient query performance. - Building and maintaining ETL/ELT pipelines using tools like Dataflow, Dataproc, Cloud Composer (Airflow), or dbt. - Optimizing query performance and managing cost-efficient BigQuery usage. - Implementing data governance, security, and compliance best practices such as IAM, data masking, and audit logging. - Collaborating with data analysts, data scientists, and business stakeholders to deliver reliable, high-quality datasets. - Ensuring data quality and consistency through monitoring, validation, and testing. - Mentoring junior engineers and contributing to best practices, coding standards, and documentation. Qualifications required for this role include: - 6+ years of experience in Data Engineering, with at least 3+ years working on BigQuery in a production environment. - Strong SQL expertise, including query optimization and advanced SQL features. - Proficiency in at least one programming language (Python, Java, or Scala). - Experience with the cloud data ecosystem, with a preference for Google Cloud Platform. - Strong understanding of data modeling, star/snowflake schemas, and OLAP concepts. - Hands-on experience with ETL/ELT frameworks and workflow orchestration tools like Airflow, Cloud Composer, and dbt. - Knowledge of data governance, lineage, and security practices. - Familiarity with streaming/batch data ingestion tools such as Pub/Sub, Kafka, or equivalent. - Exposure to machine learning workflows in BigQuery ML. - Experience with BI/visualization tools like Looker, Tableau, or Power BI. At DataNimbus, you will have the opportunity to work with cutting-edge technologies, contribute to solutions trusted by global businesses, and grow personally and professionally in a culture that values curiosity and continuous learning. If you are passionate about innovation, enjoy solving complex challenges with simplicity, and are eager to make a difference, DataNimbus is the place for you.,
ACTIVELY HIRING
posted 2 months ago
experience5 to 9 Yrs
location
Tamil Nadu, Coimbatore
skills
  • Hadoop
  • Hive
  • Java
  • GCP
  • Python
  • SQL
  • Airflow
  • PySpark
  • Dataproc
  • Composer
Job Description
Role Overview: You should have strong experience in PySpark, Hadoop, Hive, and Java. Additionally, GCP experience in migrating On-Prem applications to the Cloud or a good understanding of GCP services related to Application Migration is required. Knowledge in Python is necessary for GCP migration, and familiarity with SQL is essential. Hands-on experience in the Hadoop ecosystem and Google Cloud Platform, specifically Dataproc, Composer, and Airflow, is expected. Experience in Spark with Python is a plus. Key Responsibilities: - Understand Hadoop ecosystem and Yarn architecture. - Hands-on experience in Spark with Python, loading, and manipulating large datasets using Spark & Hive into Hadoop GCP. - Ability to debug and troubleshoot Hadoop jobs. - Strong communication and client interfacing skills to prepare implementation plans and build applications in Big Data technologies. - Responsible for all technical deliveries of the project with a good understanding of Agile & DevOps methodology. - Possess strong communication and soft skills. - Prior experience with US customers is advantageous, along with working in an offshore delivery model. Strong skills in Java/J2EE, Unix, and SQL are required. Qualifications Required: - Strong experience in PySpark, Hadoop, Hive, and Java. - GCP experience in migrating On-Prem applications to the Cloud or understanding of GCP services related to Application Migration. - Knowledge in Python or willingness to learn Python for GCP migration. - Knowledge in SQL. - Hands-on experience in the Hadoop ecosystem. - Hands-on experience in Google Cloud Platform, particularly Dataproc, Composer, and Airflow. - Nice to have experience in Spark with Python.,
ACTIVELY HIRING
posted 3 days ago

Data Engineer (GCP)

Reveille Technologies,Inc
experience6 to 10 Yrs
location
Chennai, Tamil Nadu
skills
  • GCP
  • Python
  • Airflow
  • Advanced SQL
  • Data warehousing
  • Cloud Storage
  • BigQuery
  • Data pipeline design
  • ETL processes
  • Dataflow
  • PubSub
Job Description
You will be responsible for designing data pipelines, ETL processes, and data warehousing using your strong hands-on experience in Google Cloud Platform (GCP). Your key requirements will include proficiency in Python, BigQuery, Airflow, and Advanced SQL. Additionally, having knowledge of Dataflow, Pub/Sub, and Cloud Storage will be preferred. You should also have experience working with large-scale datasets and be skilled in performance optimization. To apply for this position, please send your resume to rajesh@reveilletechnologies.com.,
ACTIVELY HIRING
posted 1 day ago
experience5 to 9 Yrs
location
Chennai, Tamil Nadu
skills
  • Clustering
  • Profiling Tools
  • Relational Databases
  • PostgreSQL
  • MySQL
  • Distributed Caching
  • Materialized Views
  • Database Performance Tuning
  • SQL Optimization
  • Schema Refactoring
  • Partitioning
  • Sharding
  • GCP Platforms
  • BigQuery
  • CloudSQL
  • AlloyDB
  • HighFrequency Financial Data Modeling
Job Description
Role Overview: As a Database Performance & Data Modeling Specialist, your primary focus will be on optimizing schema structures, tuning SQL queries, and ensuring that data models are well-prepared for high-volume, real-time systems. You will be responsible for designing data models that balance performance, flexibility, and scalability. Additionally, you will conduct performance benchmarking to identify bottlenecks, analyze slow queries, and collaborate with developers and analysts to optimize application-to-database workflows. Key Responsibilities: - Design data models that balance performance, flexibility, and scalability - Conduct performance benchmarking to identify bottlenecks and propose improvements - Analyze slow queries to recommend indexing, denormalization, or schema revisions - Monitor query plans, memory usage, and caching strategies for cloud databases - Collaborate with developers and analysts to optimize application-to-database workflows Qualifications Required: - Strong experience in database performance tuning, especially in GCP platforms like BigQuery, CloudSQL, and AlloyDB - Proficiency in schema refactoring, partitioning, clustering, and sharding techniques - Familiarity with profiling tools, slow query logs, and GCP monitoring solutions - SQL optimization skills including query rewriting and execution plan analysis - Background in mutual fund or high-frequency financial data modeling preferred - Hands-on experience with relational databases like PostgreSQL, MySQL, distributed caching, materialized views, and hybrid model structures Additional Company Details: By joining this role, you will have the opportunity to shape high-performance data systems from the ground up, play a critical role in system scalability and responsiveness, and work with high-volume data in a cloud-native enterprise setting. Soft skills that are crucial for this role include being precision-driven with an analytical mindset, a clear communicator with attention to detail, and possessing strong problem-solving and troubleshooting abilities.,
ACTIVELY HIRING
posted 1 day ago
experience2 to 6 Yrs
location
Karnataka
skills
  • Adobe Analytics
  • SQL
  • Python
  • NumPy
  • Matplotlib
  • Data Visualization
  • Data Reporting
  • Statistical Analysis
  • Data Mining
  • Verbal
  • Teamwork
  • Data Science
  • GCP BigQuery
  • Pandas
  • Seaborn
  • Ecommerce Analytics
  • User Behavior Analysis
  • Clickstream Data Analysis
  • AB Testing Analysis
  • Product Roadmap Contribution
  • Communication Written
  • ProblemSolving
  • Ecommerce
Job Description
As a Data Analyst at our organization, you will play a vital role in analyzing our ecommerce clickstream and user behavior data to uncover actionable insights that drive business growth and inform our product roadmap. Leveraging your expertise in tools such as Adobe Analytics, GCP BigQuery, SQL, and Python, you will extract, analyze, and visualize complex datasets. Working closely with our Senior Data Analyst/Architect, you will contribute to the strategic direction of our product development efforts. Your responsibilities will include: - Analyzing ecommerce clickstream data to understand user journeys and optimize website performance - Investigating user behavior patterns to enhance customer interactions - Utilizing SQL and Python to extract and manipulate large datasets from our data warehouse - Creating insightful dashboards and reports using data visualization tools to effectively communicate findings to stakeholders across different teams Collaborating with the Senior Data Analyst/Architect, you will translate data-driven insights into actionable recommendations that contribute to the development and prioritization of our product roadmap. You will define and track key performance indicators (KPIs), conduct AB testing analysis, and collaborate with cross-functional teams to provide relevant insights. Ensuring data quality and integrity, staying updated on industry trends, and continuously learning best practices in ecommerce analytics will also be key aspects of your role. To qualify for this position, you should have: - A Bachelor's degree in a quantitative field - At least 2 years of experience as a Data Analyst, preferably with a focus on ecommerce analytics - Hands-on experience with Adobe Analytics - Strong proficiency in SQL - Solid programming skills in Python - Experience with cloudbased data warehouses and data visualization tools - Strong analytical and problem-solving skills - Excellent communication and presentation skills - The ability to work independently and collaboratively in a fast-paced environment - A passion for data science and ecommerce **Note:** Key Skills required for this role include Adobe Analytics, GCP BigQuery, SQL, Python (Pandas, NumPy, Matplotlib, Seaborn), Ecommerce Analytics, User Behavior Analysis, Clickstream Data Analysis, Data Visualization, Data Reporting, AB Testing Analysis, Product Roadmap Contribution, Statistical Analysis, Data Mining, Communication (Written, Verbal), Problem-Solving, and Teamwork. Mandatory Skills for this role include Data Science and E-commerce.,
ACTIVELY HIRING
posted 1 day ago

Artificial Intelligence Engineer

Kyokan Infotech Pvt. Ltd.
experience3 to 7 Yrs
location
All India
skills
  • Machine Learning
  • Data Engineering
  • SQL
  • NoSQL
  • NumPy
  • Google Cloud Platform
  • AWS
  • Git
  • Data Visualization
  • Tableau
  • Power BI
  • AI Model Development
  • Google BigQuery
  • Python Programming
  • Scikitlearn
  • TensorFlow
  • PyTorch
  • Pandas
  • MLOps Workflows
  • Looker
Job Description
As an AI Engineer on a contract-to-hire basis, your primary responsibilities will revolve around machine learning, AI model development, and data engineering. This will include accessing and querying data from various databases, cleaning and preprocessing large datasets, and designing, developing, and implementing AI/ML models to address business challenges. Collaboration with data engineers, analysts, and business teams will be crucial in understanding data requirements, evaluating model performance metrics, and deploying models into production environments effectively. Key Responsibilities: - Access and query data from various databases - Clean and preprocess large datasets - Design, develop, and implement AI/ML models - Collaborate with data engineers, analysts, and business teams - Evaluate model performance metrics - Deploy models into production environments Qualifications Required: - Bachelor's or Master's degree in Computer Science & Engineering, Mathematics, Data Science, or related technical field - Equivalent hands-on industry experience in AI/ML and data engineering - Proficiency in Google BigQuery, SQL, NoSQL, Python programming - Experience with ML libraries/frameworks like Scikit-learn, TensorFlow, PyTorch, Pandas, NumPy - Familiarity with cloud platforms such as Google Cloud Platform and AWS - Experience with MLOps workflows and version control systems like Git - Strong analytical thinking and problem-solving abilities - Excellent communication skills - Capability to work independently in a hybrid work environment The work arrangement for this role will be hybrid, primarily remote with occasional onsite meetings at the Kolkata office. Availability for in-office work when necessary is required.,
ACTIVELY HIRING
posted 2 months ago

SQL & Google BigQuery Developer

Vizlogic Digital Solutions
experience3 to 7 Yrs
location
Haryana
skills
  • SQL
  • ETL
  • OLAP
  • Google BigQuery
Job Description
As a SQL & Google BigQuery Developer at the company, your main responsibilities will include: - Delivering high quality data outcomes through modern data sourcing, integration, and modeling techniques. - Designing, developing, and deploying high-performing SQL & Google BigQuery solutions on the Google Cloud Platform. The ideal candidate for this role should possess the following qualifications: - Strong database design and SQL skills, including functions, stored procedures, and complex queries. - Experience working with RDBMS such as MS SQL Server. - Proficiency in ETL (Extract, Transform, Load) & OLAP (Online Analytical Processing). - Knowledge and experience in SQL & BigQuery. This role falls under the Software Developer category in the IT Services & Consulting industry. It is a full-time, permanent position requiring candidates to have at least a graduate degree.,
ACTIVELY HIRING
posted 2 months ago
experience3 to 7 Yrs
location
Chennai, Tamil Nadu
skills
  • Python
  • Java
  • Google Cloud Platform
  • RESTful APIs
  • Docker
  • Vertex AI Dialogflow
  • Cloud Functions
  • natural language processing NLP
  • webhook development
  • containerization tools
  • thirdparty libraries
  • multiagent architectures
  • orchestration strategies
Job Description
Role Overview: You will be responsible for building modular and scalable agents using ADK's orchestration primitives, developing multi-agent systems with hierarchical coordination and delegation, and implementing custom tools while integrating pre-built ones. Additionally, you will be containerizing and deploying agents across various platforms and defining intents, entities, and session states for conversational agents. Key Responsibilities: - Build modular and scalable agents using ADK's orchestration primitives - Develop multi-agent systems with hierarchical coordination and delegation - Implement custom tools and integrate pre-built ones - Integrate agents with Google Cloud services such as Vertex AI Dialogflow, Cloud Functions, and Cloud Run - Containerize and deploy agents across platforms including web, mobile, and embedded systems - Define intents, entities, and session states for conversational agents - Implement webhook logic using Node.js or Python for dynamic responses and backend integration - Use ADK's built-in evaluation tools to assess agent performance - Debug and monitor agents using Google Cloud Logging and Dialogflow Debug Console - Apply safety and security patterns to ensure trustworthy agent behavior - Follow best practices for NLU accuracy, fallback handling, and session management Qualifications Required: - Strong proficiency in Python or Java - Experience with Google Cloud Platform (GCP) especially Vertex AI Dialogflow and Cloud Functions - Familiarity with natural language processing (NLP) concepts and tools - Hands-on experience with webhook development and RESTful APIs - Knowledge of containerization tools like Docker - Ability to work with third-party libraries such as LangChain CrewAI - Understanding of multi-agent architectures and orchestration strategies,
ACTIVELY HIRING
posted 3 days ago
experience3 to 7 Yrs
location
Haryana
skills
  • Data Engineering
  • Data Processing
  • Dashboards
  • ETL
  • Airflow
  • SSIS
  • Tableau
  • SSRS
  • Data Systems
  • Data Pipelines
  • Data Storage Optimization
  • Data Accuracy
  • Analytical Models
  • BigQuery
  • Clean Code Principles
  • Modular Design
Job Description
As a Data Engineer, you will be responsible for designing and building data systems and pipelines. This includes developing data processing workflows, optimizing data storage, and ensuring data accuracy. Your role will involve the design and deployment of analytical models and dashboards to uncover insights, predict trends, and inform decision-making. You will collaborate with teams to provide data support for transformation initiatives, ensuring alignment with business objectives and digital innovation goals. Additionally, you will oversee technical designs for data models, ETL, and visualization tools such as BigQuery, Airflow, SSIS, Tableau, and SSRS. Your key responsibilities will include: - Developing data processing workflows - Optimizing data storage - Ensuring data accuracy - Designing and deploying analytical models and dashboards - Collaborating with teams to provide data support for transformation initiatives - Overseeing technical designs for data models, ETL, and visualization tools Qualifications required for this role: - Strong proficiency in data processing workflows and optimization - Experience with analytical model design and deployment - Familiarity with ETL and visualization tools like BigQuery, Airflow, SSIS, Tableau, and SSRS - Knowledge of best practices for analytical code and data pipelines, focusing on readability, maintainability, and efficiency using clean code principles and modular design. Please note: No additional details of the company were provided in the job description.,
ACTIVELY HIRING
posted 4 days ago
experience4 to 8 Yrs
location
Maharashtra, Pune
skills
  • SQL
  • Spark
  • Scala
  • Python
  • Java
  • Tableau
  • Power BI
  • Alteryx
  • Google Data Products
  • BigQuery
  • Dataproc
  • Dataplex
  • Looker
  • Cloud data fusion
  • Data Catalog
  • Dataflow
  • Cloud composer
  • Analytics Hub
  • PubSub
  • Dataprep
  • Cloud Bigtable
  • Cloud SQL
  • Cloud IAM
  • Google Kubernetes engine
  • AutoML
  • Qlik replicate
  • Qlik
  • Informatica Data Quality
Job Description
As a Data Engineer at Aptiv, you will play a crucial role in designing, developing, and implementing a cost-effective, scalable, reusable, and secure Ingestion framework. Your responsibilities include working closely with business leaders, stakeholders, and source system SMEs to understand and define business needs, translate them into technical specifications, and ingest data into Google Cloud platform, specifically BigQuery. Additionally, you will be involved in designing and implementing processes for data ingestion, transformation, storage, analysis, modeling, reporting, monitoring, availability, governance, and security of high volumes of structured and unstructured data. **Key Responsibilities:** - Pipeline Design & Implementation: Develop and deploy high-throughput data pipelines using the latest GCP technologies. - Subject Matter Expertise: Serve as a specialist in data engineering and Google Cloud Platform (GCP) data technologies. - Client Communication: Engage with clients, understand their requirements, and translate them into technical data solutions. - Technical Translation: Analyze business requirements, convert them into technical specifications, create source-to-target mappings, enhance ingestion frameworks, and transform data based on business rules. - Data Cataloging: Develop capabilities to support enterprise-wide data cataloging. - Security & Privacy: Design data solutions focusing on security and privacy. - Agile & DataOps: Utilize Agile and DataOps methodologies in project delivery. **Qualifications Required:** - Bachelor's or Master's degree in Computer Science, Data & Analytics, or similar relevant subjects. - 4+ years of hands-on IT experience in a similar role. - Proven expertise in SQL, including subqueries, aggregations, functions, triggers, indexes, database optimization, and relational data-based models. - Deep experience with Google Data Products such as BigQuery, Dataproc, Dataplex, Looker, Data Catalog, Dataflow, and more. - Experience in Qlik Replicate, Spark (Scala/Python/Java), and Kafka. - Excellent written and verbal communication skills to convey technical solutions to business teams. - Knowledge of statistical methods, data modeling, and industry standards in the Data and Analytics space. - Ability to work effectively with globally distributed teams. - Proficiency in designing and creating Tableau/Qlik/Power BI dashboards, Alteryx, and Informatica Data Quality. Furthermore, Aptiv provides an inclusive work environment where individuals can grow and develop, irrespective of gender, ethnicity, or beliefs. Safety is a core value at Aptiv, aiming for a world with Zero fatalities, Zero injuries, and Zero accidents. The company ensures resources and support for your family, physical, and mental health with a competitive health insurance package. **Benefits:** - Personal holidays - Healthcare - Pension - Tax saver scheme - Free Onsite Breakfast - Discounted Corporate Gym Membership In addition to the above benefits, you will have the opportunity for professional growth and development in a multicultural environment, access to internal and external training, coaching, certifications, recognition for innovation and excellence, and convenient transportation options at Grand Canal Dock. If you are passionate about data engineering, Google Cloud Platform, and making a positive impact in the mobility industry, we invite you to join Aptiv's IT Data Analytics team and contribute to our mission of creating a safer, greener, and more connected world.,
ACTIVELY HIRING
posted 1 month ago
experience6 to 10 Yrs
location
Noida, Uttar Pradesh
skills
  • NET
  • C
  • VB
  • SQL
  • Boomi
  • Oracle
  • PostgreSQL
  • MySQL
  • SQL Server
  • Stored Procedures
  • XML
  • Apigee
  • JIRA
  • Confluence
  • Liquibase
  • GCP
  • Google BigQuery
  • DTSX
  • Gemini Code Assist
Job Description
Role Overview: As a .NET & Google BigQuery Developer, you will play a crucial role in supporting the transition process by developing and optimizing data integrations, analytics pipelines, and reporting solutions. Your responsibilities will include designing and developing .NET-based applications, managing data pipelines between on-prem and cloud environments, developing and optimizing queries in Google BigQuery, collaborating with data engineers and architects, and ensuring data integrity and performance. You will also participate in Agile development cycles and document code and architecture. Key Responsibilities: - Design and develop .NET-based applications and services to support migration and integration needs. - Build and manage data pipelines between on-prem and cloud environments using SQL, DTSX, and Boomi. - Develop and optimize queries, transformations, and reports in Google BigQuery. - Collaborate with data engineers and architects to ensure data integrity, performance, and scalability. - Support data validation, migration audits, and reconciliations between legacy and cloud systems. - Participate in Agile development cycles, following MWoW principles. - Document code, architecture, and data mappings in Confluence and track deliverables in JIRA. Qualification Required: - Proficiency in .NET (C#, VB) development with strong database integration skills. - Hands-on experience with Google BigQuery (BQ) for SQL-based analytics and data warehousing. - Knowledge of Oracle, PostgreSQL, MySQL, and SQL Server. - Experience with DTSX, Stored Procedures, and XML data exchange. - Familiarity with Apigee, Boomi, JIRA, and Confluence. Additional Details: The company expects the candidate to have experience ranging from 6 to 10 years and the job location is in Noida and Hyderabad with a hybrid work setup.,
ACTIVELY HIRING
posted 6 days ago
experience3 to 7 Yrs
location
Maharashtra, Pune
skills
  • Snowflake
  • SQL
  • data transformation
  • data analysis
  • data reporting
  • data governance
  • data security
  • data monitoring
  • Airflow
  • data warehousing
  • data modeling
  • clustering
  • performance tuning
  • dbt
  • Python
  • data engineering
  • data governance
  • Google Cloud Platform
  • Cloud Storage
  • GCPnative tools
  • Cloud Composer
  • partitioning
  • ELT tools
  • Fivetran
  • Cloud Data Fusion
  • scripting language
  • privacy
  • BigQuery
  • Dataflow
  • PubSub
Job Description
Role Overview: As a Data Engineer, your role will involve designing, developing, and maintaining data pipelines and ETL/ELT workflows using GCP-native tools and services. You will be responsible for building and optimizing data warehouses using Snowflake and writing complex SQL queries for data transformation, analysis, and reporting. Collaboration with analysts, data scientists, and business stakeholders to understand data needs and deliver reliable solutions will be a key part of your responsibilities. Additionally, you will be implementing data governance, security, and monitoring best practices across GCP projects and tuning queries to optimize performance of large-scale datasets. Automation of workflows using Cloud Composer (Airflow) or similar orchestration tools will also be a part of your tasks. Key Responsibilities: - Design, develop, and maintain data pipelines and ETL/ELT workflows using GCP-native tools and services. - Build and optimize data warehouses using Snowflake. - Write complex and efficient SQL queries for data transformation, analysis, and reporting. - Collaborate with analysts, data scientists, and business stakeholders to understand data needs and deliver reliable solutions. - Implement data governance, security, and monitoring best practices across GCP projects. - Tune queries and optimize performance of large-scale datasets. - Automate workflows using Cloud Composer (Airflow) or similar orchestration tools. Qualification Required: - 3+ years of experience in a data engineering or data platform role. - Strong hands-on experience with Snowflake data warehousing. - Expert-level skills in SQL, able to write optimized, scalable, and complex queries. - Experience with data modeling (star/snowflake schema), partitioning, clustering, and performance tuning in a data warehouse. - Familiarity with modern ELT tools such as dbt, Fivetran, or Cloud Data Fusion. - Experience in Python or similar scripting language for data engineering tasks. - Understanding of data governance, privacy, and Google Cloud Platform services, especially BigQuery, Cloud Storage, Dataflow, Pub/Sub, Composer.,
ACTIVELY HIRING
posted 1 day ago
experience2 to 6 Yrs
location
Maharashtra, Pune
skills
  • SQL
  • R
  • Python
  • Advanced Excel
  • Data Visualization
  • Power Bi
  • Tableau
  • QlikView
  • SciPy
  • PuLP
  • CPLEX
  • Project Management
  • Business Acumen
  • Machine Learning Algorithms
  • Power Apps
  • Google Data Studio
  • Google Cloud Platform GCP
  • BigQuery
  • Salesforce Einstein Analytics
  • Optimization Techniques
  • Pyomo
  • Gurobi
Job Description
As a Sales Excellence - COE - Advanced Modeling Specialist at Accenture, you will be part of the team that empowers individuals to compete, win, and grow by providing the necessary tools to enhance client portfolios, optimize deals, and nurture sales talent through sales intelligence. - Utilize your expertise in machine learning algorithms, SQL, R or Python, Advanced Excel, and data visualization tools like Power Bi, Power Apps, Tableau, QlikView, and Google Data Studio. - Knowledge of Google Cloud Platform (GCP) and BigQuery, experience in Sales, Marketing, Pricing, Finance or related fields, familiarity with Salesforce Einstein Analytics, and understanding of optimization techniques and packages such as Pyomo, SciPy, PuLP, Gurobi, CPLEX or similar would be advantageous. Your responsibilities will include: - Generating business insights to enhance processes, increase sales, and maximize profitability for Accenture. - Developing models and scorecards to aid business leaders in comprehending trends and market drivers. - Collaborating with operations teams to transform insights into user-friendly solutions. - Managing tool access and monitoring usage. To excel in this role, you should have: - Bachelor's degree or equivalent experience. - Exceptional English communication skills. - Minimum of four years of experience in data modeling and analysis. - Proficiency in machine learning algorithms, SQL, R or Python, Advanced Excel, and data visualization tools. - Project management experience. - Strong business acumen. - Meticulous attention to detail. Furthermore, a sound understanding of sales processes and systems, prior experience with Google Cloud Platform (GCP) and BigQuery, working knowledge of Salesforce Einstein Analytics, familiarity with optimization techniques and packages, and experience with Power Apps would be beneficial. This position requires a minimum of 2 years of relevant experience and a Master's degree in Analytics or a similar field. Join us at Accenture, where we are committed to driving sales excellence and enabling you to leverage your analytical skills to make a meaningful impact.,
ACTIVELY HIRING
logo

@ 2025 Shine.com | All Right Reserved

Connect with us:
  • LinkedIn
  • Instagram
  • Facebook
  • YouTube
  • Twitter