Senior C/C++ Engineer (AI)

Job Description

Jan is a desktop application that turns computers into thinking machines, enabling open-source LLMs and remote API AIs on Windows, Mac, or Linux. Since its January 2024 release, it has been downloaded over 500,000 times. With a vision to redefine human-machine collaboration, Jan aims to revolutionise our interaction with technology. It ensures complete ownership, privacy, and full customisation for its users.
We are a fully remote, open source company. We target the global market, but operate as a lean, bootstrapped company.
Responsibilities:

Optimize inference, or
Write kernels, compilers, low level API
Contribute towards important open source dependencies like Vulkan, OpenCL, llama.cpp

Requirements:

Proven experience in C++ development, with a strong foundation in computer science fundamentals
Experience building C++ applications from the ground up, including proficiency in design patterns, data structures, and algorithms
Solid understanding of:

High-performance computing principles and techniques
Hardware optimization strategies for embedded systems and GPUs (e.g., NVIDIA CUDA, OpenCL)
Low-level programming languages such as Assembly or Rust


Minimum 3 years of professional work experience in a similar role
Self-starter with an entrepreneurial mindset and ability to work independently

Tools and Technologies:

Familiarity with GPU acceleration frameworks such as Vulkan or Metal
Experience with C++ compilers like GCC, Clang, or ICC
Understanding of computer architecture and memory hierarchy
Proficiency in debuggers and profiling tools (e.g., GDB, Valgrind)

Benefits:

We pay an “all-in” pay and you will cover your own insurance/medical from the amount
14 days leave (and unlimited sick days)
Annual equipment budget (once 2 month probation has been completed)

* Please submit only 1 application, as you will be considered across roles. Duplicate submissions will be automatically archived.
About Homebrew:
Homebrew is an AI R&D studio optimizing “intelligence per watt”. We open source AI tools, models, and infrastructure for an optimistic future where humans and AI collaborate & thrive.
We are the creators and lead maintainers of:

 jan.ai: Personal AI (2 million+ downloads)
 cortex.so: Self-hosted AI Platform
 Ichigo-llama3: Native speech model