Extraction
==========

Convert the mirror into sharded JSONL corpora.

Corpus extraction
-----------------

.. automodule:: litsync.extract
   :members:
   :undoc-members:
   :show-inheritance:

Resume state
------------

.. automodule:: litsync.extract_state
   :members:
   :undoc-members:
   :show-inheritance: