Overview

Introduction

This page provides a systems overview of the Extract API. This API enables customers to submit medical PDFs for processing with selected pipelines and collect the output files. The Extract API serves as an interface that triggers processing pipelines built using proprietary AI-based document solutions:

  • Document Manager
  • emtelliPro Medical Language Engine
  • Clinical Extraction Libraries

These capabilities are orchestrated behind the scenes with optimized configurations to extract ready-to-use clinical information from medical documents.

High-level systems overview of clinical extraction pipeline

Links to Tutorials

Extract API Overview

At a high-level our data extraction pipelines consist of these key stages:

  1. Ingestion
  2. Document Splitting & Classification & OCR
  3. Medical NLP Processing
  4. Clinical Extractions

Our extraction pipelines are designed to process PHI-containing real-world medical documents. All systems are run in restricted environments that are HIPAA compliant and HITRUST certified.

Stage 1: Ingestion

In this first stage, we:

  • perform validation of the file manifest that is provided by the customer
  • check that all source files listed in the manifest can be accessed before beginning the transfer
  • transfer documents from AWS S3 buckets to the processing environment
  • ensure that all files were transferred successfully before beginning the processing steps

Stage 2: Document Splitting & Classification & OCR

In this stage, the Document manager:

  • splits PDF bundles into individual clinical documents
  • classifies document types (e.g., “Cardiology - ECG Report”) and extracts document metadata
  • performs OCR text extraction

Stage 3: Medical NLP Processing

In this stage, the emtelliPro engine:

  • processes OCR text output
  • identifies clinical entities, relations and assertions

Stage 4: Clinical Extraction

Finally, in this stage, using the combined outputs of preceeding stages, we:

  • perform complex data extraction steps for selected clinical domains such as problems, procedures, family history using Physician designed, reviewed and curated extraction libraries and scripts. See Clinical Extraction Overview
  • collate answers and produce outputs as CSV and JSONL files

After extraction and collation are complete, the output is available for retrieval by the customer. This data flow is accessed via the Extract API.