T

text-processing

ZigStr - A comprehensive Unicode string library for Zig with SSO, full Unicode normalization (NFC/NFD/NFKC/NFKD), text segmentation, collation, regex, fuzzy matching, and support for legacy encodings (CJK, Windows code pages, ISO-8859)

UnchainedText: Break free from PDFs! Easily extract raw text to .txt for preprocessing.

Automated Dataset Creation & Publishing Pipeline - Scrape, clean, transform, validate and publish datasets to HuggingFace Hub

https://ayinedjimi-consultants.fr

Python tool to selectively merge and filter source code from multiple files into a single output, tailored for input to Large Language Models (LLMs) via a powerful YAML configuration and in-code tags.