5 personal projects you can create with GPT-OSS, ChatGPT's new open-source AI

146

    Why is everyone talking about GPT-OSS?

    OpenAI has just launched GPT-OSS-20B y GPT-OSS-120B, the first models with open-weights Following GPT-2, released under the Apache 2.0 license. This allows you to download and run them without token costs, and even fine-tune them on your own machines.The Times of India, GitHub)

    The version of 120 B It achieves a performance almost identical to the commercial model. o4-mini and can run on a single 80GB GPU, while the 20 B is approaching o3-mini and it can even run on laptops with 16 GB of RAM.OpenAIBoth incorporate expert-mixing and 4-bit quantization, which reduces memory and speeds up inference.Hugging Face)

    In addition, OpenAI increased the weights of Hugging Face and GitHub, making it easier to pip install and integration with Transformers or vLLM to serve them via local API in a matter of minutes.Hugging Face, GitHub)


    Why run GPT-OSS locally?

    Advantage GPT-OSS on local Cloud API
    Cost €0 per token (hardware/electricity only) Pay-per-use
    Privacy The data never leaves your device. Data travels to external servers
    Latency Milliseconds (without network) Connection dependency
    Control You modify weights, code and prompts Limited to official endpoints
    Unlimited use Ideal for mass testing Request rate and billing

    5 personal project ideas with GPT-OSS

    I propose 5 personal projects based on this open-source model and, so you can get started immediately, I've also included a link GitHub repository with the initial template of each one

    1. Private email assistant

    Classify, summarize, and write replies to your emails (Gmail, Outlook, IMAP) without uploading them to no server.
    How to get started: GPT-OSS-20B + IMAP library in Python + TUI interface.


    2. “Second Brain” for your notes and PDFs

    Index your folder of saved notes, papers, and websites; then ask questions in natural language.
    Stack: local embeddings + Chroma or DuckDB as vector store + GPT-OSS-20B for the retriever.


    3. Family Story Generator

    Turn scanned diaries, transcribed voice notes, and OCR photos into a narrative book without exposing intimate data.
    Pipeline: Tesseract (OCR) → Whisper-cpp (transcription) → GPT-OSS-20B (writing) → Pandoc (layout).


    4. Offline programming tutor

    Analyze your code, explain errors, and propose improvements when you don't have internet access (trips, hackathons).
    Extra: Integrates with linters (PEP-8, ESLint) for personalized tips.


    5. Smart Game-modding

    Generate dialogues, missions, and AI rules for your indie game testing thousands of prompts without spending a penny.
    Recommended setup: GPT-OSS-120B with vLLM serving a local API for Unity or Unreal.


    Good installation practices

    1. Indicative hardware
    2. GPT-OSS-20B → Ryzen 7/i7 CPU with 32 GB RAM or 8–16 GB GPU.
    3. GPT-OSS-120B → GPU 80 GB (A100/H100) or multi-GPU cluster.
    4. Containers ready
      Northflank and Azure AI Foundry offer “one-click deploy” with vLLM + Open WebUI.Microsoft Azure, Northflank)
    5. Local security
      Encrypt the disk and use separate users if you share a computer.
    6. Monitors temperature
      Sustained inference heats up the CPU/GPU; it uses nv-top o psensor.

    Conclusion

    GPT-OSS democratizes powerful AI by literally putting it on your hard drive: zero cost per token, absolute privacy and total control. If you are maker Whether you're a curious developer or any of these 5 projects, they'll show you why the community is talking about "the new open-source era of ChatGPT".

    Are you up for it? Contact me to tell me which project you're going to try first and, if you need step-by-step guides, I'd be happy to go into more detail.

    ✉ SHALL WE TALK?

    Let's talk

    If we share interests in artificial intelligence, data, or software development, I'd be happy to exchange ideas. You can also contact me for professional matters.

    Read the blog