Manager – Software Engineering (Data Extraction) with Python, APIs, RabbitMQ, Celery, PostgreSQL, Docker

About the Company and Role

UniCourt India pioneers cutting-edge software that democratizes access to legal and court data through innovative Legal Data as a Service (LDaaS). Operating between Mangalore, India and California, their team is composed of diverse professionals including legal experts, data scientists, and engineers. Serving a broad client base such as Fortune 500 companies, AmLaw firms, and sectors including legal, finance, insurance, and government, they offer real-time court data access via APIs and their SaaS platform.

They seek a seasoned Manager in Software Engineering specializing in Data Extraction to lead and expand their core backend systems. This hands-on leader will focus on developing robust Python-based data ingestion, transformation, and processing pipelines while ensuring accuracy and efficiency within the legal tech domain.

Key Responsibilities

• Lead sprint planning, resource allocation, and sprint execution with Product and QA teams to ensure timely delivery of data extraction goals.
• Own and finalize high-level requirement documents and functional design documents collaborating closely with product managers, CTO, and stakeholders.
• Manage Jira backlogs, create user stories and tasks that drive data projects.
• Review and enhance interface design for API integrations.
• Approve QA test plans focusing on data extraction, validation, and transformation.
• Define continuous integration and deployment requirements ensuring test coverage blocks faulty deployments.
• Partner with QA and engineering teams to address and resolve recurring data issues and optimize validation.
• Oversee release management practices guaranteeing smooth software rollouts and documentation.
• Ensure data projects meet deadlines while maintaining quality and scalability, communicating proactively on any delays or deviations.
• Manage incident reporting with thorough root cause analysis and corrective action plans.
• Monitor dashboards tracking extraction performance, latency, failures, and data freshness.
• Define governance processes with development and release checklists, coding standards, and documentation upkeep.
• Control AWS cloud costs associated with crawling, storage, and pipelines.
• Research and implement new Python tools and frameworks to enhance extraction quality and efficiency.
• Drive proof of concepts for scalable solutions involving technologies like Scrapy, FastAPI, Airflow, and AWS Lambda.
• Recruit and build teams focused on scalable, performant, automated data solutions.
• Design and administer technical assessments for candidates specialized in Python and data pipelines.
• Provide regular mentorship and technical guidance to engineers to strengthen skills and career progression.
• Foster a culture of innovation, empathy, transparency, and clear communication across teams and leadership.

Qualifications and Skills

• Bachelor’s or Master’s degree in Computer Science or a related field.
• At least 10 years in software engineering, including 2 to 3 years in a leadership or management capacity.
• Proficient in Python programming with experience in frameworks such as FastAPI, Django, Flask, or Scrapy.
• Expertise in containerization using Docker and deployment on Kubernetes (K8S).
• Hands-on with data extraction, web scraping, ETL pipelines, and related data processing frameworks.
• Strong experience with AWS services including Lambda, EC2, S3, RDS, and CloudWatch, as well as CI/CD pipelines.
• Knowledge of orchestration and automation tools like Airflow, Kafka, or Celery.
• Solid understanding of Agile methodologies, software development lifecycle (SDLC), and DevOps principles.
• Excellent leadership, communication, and problem-solving capabilities.
• Experience in legal technology, data analytics, or SaaS sectors is highly advantageous.