Establish repository structure

[iamrobzy]

Establishing more structures/directories in this repository is necessary to maintain organization, especially before contributions/developments increase. Feel free to suggest different directories/structures to ease scalable development.

[jurmy24]

Current Structure:

Directory structure:
└── tanzania-ai-community-twiga-warehouse/
    ├── README.md
    ├── pyproject.toml
    ├── uv.lock
    ├── .env.template
    ├── .python-version
    ├── database/
    │   ├── __init__.py
    │   ├── enums.py
    │   ├── models.py
    │   └── utils.py
    └── scripts/
        ├── cli.py
        ├── new_class.py
        ├── new_resource.py
        ├── new_subject.py
        └── schema_validator.py

Potential structure (imo):

Directory structure:
└── tanzania-ai-community-twiga-warehouse/
    ├── README.md
    ├── pyproject.toml
    ├── uv.lock
    ├── .env.template
    ├── .python-version
    ├── database/
    │   ├── __init__.py
    │   ├── enums.py
    │   ├── models.py
    │   └── utils.py
    └── scripts/ (maybe rename this folder to **uploading** or something
        ├── cli.py
        ├── new_class.py
        ├── new_resource.py
        ├── new_subject.py
        └── schema_validator.py (maybe put somewhere else or remove)
    └── pdf-parsing/
        ├── pypdf.py
        ├── unstructured.py
└── chunking/
        ├── README.md (explaining how the metadata should look)
        ├── character_splitter.py
        ├── markdown_splitter.py