Jan 29
Source management - Duplicates & Compression
Detect duplicate sources by both filename and content similarity, then present a review step before allowing users to delete, merge, or otherwise resolve duplicates.Also add source compression features:LLM-optimized compression (cleaning/condensing content to improve retrieval and usefulness), andfile consolidation (combining multiple sources into fewer files) to help users stay under the platform’s source limit.
Completed
Made an update for v1.5.2 but I think we should go with scanning duplicate sources only and deleting sources when duplicates are detected. I hope it helps, and have a nice weekend.