Entry Level Business Analyst - AI Rules & Optimization Job at CaseScribe, Alexandria, VA

SUtBcldOb1ZLM3FzSFFTTXRTdXJ6c3dVNVE9PQ==
  • CaseScribe
  • Alexandria, VA

Job Description

About CaseScribe

CaseScribe is a legal AI platform purpose-built to streamline the review and summarization of large document sets—like veterans’ disability claims files—by leveraging advanced machine learning and OCR. We help legal professionals focus on strategy, not paperwork, by converting thousands of pages of unstructured documents into actionable insights in minutes. 

Position Summary

We are looking for a highly analytical and business-minded Business Analyst who will own the development and optimization of our document classification, tagging, and summarization rules. This could be a good fit for a recent graduate given the right coursework and project experience. This hybrid role blends data science, domain-specific legal workflows, client engagement, and internal tool optimization. You will also lead efforts in building training datasets, improving AI output accuracy, and guiding enterprise clients on best practices for document automation.

Key Responsibilities

AI Classification and Summarization Rules

Design, test, and maintain rulesets for:

  • Document class definitions
  • Document categorization
  • Tagging taxonomies
  • Summarization logic and content extraction rules
  • Build robust logic for procedural histories, IME generation guides, and veteran claim narratives.

Metrics and Reporting

  • Use SQL and Retool to create dashboards, performance diagnostics, and ad-hoc reports for internal stakeholders.
  • Track rule performance across cases and iterate based on data signals.

Training Data

  • Create, curate, and maintain gold-standard labeled datasets for AI training and evaluation.
  • Design and manage test cases across various edge scenarios (e.g., new codesheets, duplicate documents, scanned hand-written pages).

Client Facing Reports

  • Lead or assist in client engagements involving AI rules customization or optimization.
  • Deliver consultations on best practices for document AI transformation based on domain knowledge.
  • Provide feedback loops from clients to product and engineering for iterative improvement.

Skills & Experience

  • 3+ years (work or school) in data analytics, business intelligence or data mining. If you have limited direct work experience, must have highly relevant coursework and projects.
  • Fluency in SQL; experience using Retool or similar low-code tools
  • Strong conceptual and applied knowledge of machine learning classification and rule-based systems
  • Excellent written and verbal communication skills
  • Ability to bridge business logic with technical implementation

What Success Looks Like

  • Reduction in misclassified or poorly summarized documents across client accounts
  • Shorter onboarding cycles for new document types and client configurations
  • Document rules and summarization logic are version-controlled, well-documented, and QA’d
  • Clients view you as a trusted expert on document automation and CaseScribe capabilities

Job Tags

Work experience placement,

Similar Jobs

Intelliswift - An LTTS Company

Scrum Master Job at Intelliswift - An LTTS Company

 ...Job Title: Scrum Master Duration: 9 Months Location: Oakland, CA-95110 Pay Rate: $101.30/hr. Intelliswift Software Inc. conceptualizes, builds, and supports the world's most amazing technology products and solutions. Our team of rich experts from diverse backgrounds... 

Capelli Sport

Data Entry Assistant Job at Capelli Sport

Who We Are: Capelli Sport is a global multi-sports brand based in New York City and New Jersey, specializing in team sports. With a strong club community reaching all corners of the world, we empower and unite people from amateur, to youth and pro clubs. Our goal is to...

Trillium Construction Services

Field Technician Job at Trillium Construction Services

 ...diagnostics, and robotics troubleshooting. Compensation: - $40/hour - Company Vehicle Field Service & Inspections -Travel to remote job sites to perform preventive and corrective maintenance on fleet assets. -Conduct physical and electronic inspections... 

The Planet Group

Civil Project Engineer - 640783 Job at The Planet Group

 ...Salary Range: $75,000 $95,000 DOE (up to $100K for 68 years experience) Employment Type: Full-Time | Onsite NO SPONSORSHIP...  ...provide project updates. Provide technical support during construction and assist in resolving design-related issues. Occasional... 

US Foods

Meat Cutter Job at US Foods

 ...in Charlotte NC, then move to Lexington NC in April 2026 ESSENTIAL DUTIES AND RESPONSIBILITIES: Trim and customize portions of meat products using knives, band saws or other meat production equipment. Count and stack on tray portions per customer and company specifications...