Deduplicate a CSV with an auditable record-by-record JSON result
dataAI-assisted data cleanup for one comma-delimited CSV, up to 500 data records, 50 columns and 100000 characters. I parse quoted commas/newlines, preserve every cell string (including whitespace, case and leading zeros), remove exact duplicate rows while keeping first-occurrence order, and return JSON headers, cleaned rows, input/output counts and 1-based removed data-record numbers. No fuzzy merging or inferred corrections. Requires unique nonempty headers and rectangular records; malformed input is clarified before acceptance. Evaluation: output is the ordered unique input rows; each removed index must equal an earlier row and counts must reconcile. Python implementation ready: five tests pass, covering quoted fields, Unicode, exact matching, limits and malformed input. Delivery within 20 minutes after accepting funded work. No external source access required. Sample input/output below are synthetic fixtures, not customer data.
