AM

Arish Mahammad

B.Tech CSE student · Data & ML Engineer

Kolkata, West Bengal, India

@arish_mahammad

0 followers

Bachelor of Technology in Computer Science Engineering, Specialized with Data Science at Institute of Engineering & Management (IEM) · Graduating 2028

About

B.Tech Computer Science Engineering student specializing in Data Science, with hands-on experience building scalable data platforms and machine learning systems across streaming, batch processing, cloud infrastructure, and analytics. Experienced with Python, SQL, Kafka, PySpark, Airflow, AWS, and FastAPI, and has delivered end-to-end projects with measurable performance results.

Experience

  • Generative AI Engineer
    AI Wallah
    May 2025 – Present

    Engineered a FastAPI-based Generative AI backend integrating LLM APIs and modular prompt templates, reducing content generation time from 4 hours to 90 minutes per day through automated pipeline orchestration. Designed and tested RESTful API endpoints using FastAPI and Postman, delivering scalable AI-powered content generation across 5+ domains, improving maintainability and eliminating manual intervention.

Education

Skills

Tools / apps / platforms

1 to 2 years 1 to 2 years A year or two of steady use.
Postman
<3 months <3 months Just getting started - under three months. This is also what shows when a level has not been set.
S3 Git RDS Neon Linux MySQL Docker DuckDB GitHub Mlflow Render Snowflake PostgreSQL Apache Kafka Apache Airflow GitHub Actions Microsoft Excel Microsoft Power BI Amazon Web Services AWS Amazon Elastic Compute Cloud EC2

Projects

  • SQL, Excel, Power BI, Data Modeling

    Analyzed 100K+ OLA ride-booking records using SQL and Power BI, uncovering actionable insights across 8+ KPIs including bookings, cancellations, revenue trends, and customer behaviour patterns. Built interactive Power BI dashboards on star-schema data models with optimized SQL queries, reducing reporting query time by 40% and enabling faster operational decision-making.

  • FastAPI, Kafka, PySpark, Airflow, PostgreSQL, AWS, Docker, Streamlit

    Architected an end-to-end real-time data platform for 5 cryptocurrency streams using Kafka, PySpark Structured Streaming, FastAPI, PostgreSQL, and Airflow, implementing automated ingestion, distributed processing, and workflow orchestration. Engineered and load-tested the Kafka → PostgreSQL streaming pipeline, sustaining 309.53 events/sec with 0 failed writes across 1,000 synthetic events while validating 100% successful database persistence and end-to-end data integrity. Containerized and deployed the platform on AWS EC2 using Docker Compose, integrating S3, RDS PostgreSQL, and IAM for cloud storage, persistent data serving, and access control; implemented Isolation Forest anomaly detection with a real-time Streamlit monitoring layer.

  • FastAPI, PySpark, Kafka, AWS, DuckDB, Snowflake, Airflow, MLflow, PyTorch, Streamlit

    Architected an end-to-end Medallion data lake (Bronze/Silver/Gold) using Kafka, PySpark Structured Streaming, AWS S3, and Airflow, transforming real-time AQI data into 6 analytics-ready Gold tables through automated ingestion, processing, and orchestration. Engineered a production-style streaming and batch pipeline with decoupled ingestion, transformation, storage, and serving layers, leveraging PySpark, Kafka, Airflow, and S3 for scalable processing and reproducible workflow execution. Built and operationalized an LSTM-based AQI forecasting pipeline using PyTorch and MLflow for model training, experiment tracking, and versioning, exposing predictions through Streamlit and deploying serving infrastructure on AWS EC2 with documented, reproducible deployment workflows.

Achievements & awards

  • 350+ DSA problems solved across LeetCode & GeeksforGeeks

    Covering Arrays, Strings, Linked Lists, Stacks, Queues/Deques, Trees, Graphs, and Heaps.

  • Professional Certificate in Data Engineering

    Astronomer, Snowflake & Azure Databricks; Architecting Solutions on AWS — Amazon Web Services.

  • Built and deployed 2 production-style cloud data engineering projects on AWS

    Documented architecture, testing, and deployment workflows.

Explore the Broxer community

Online · instant AI help
Broxer