Folk N

Folk N pushes the boundaries of local AI by developing innovative solutions like Knit, which enables on-device and distributed inference. Folk N's distinctive angle is their focus on leveraging existing hardware to run large language models, as seen in their example of running a 3B model on a phone by offloading computation to a laptop. Folk N's work stands out by providing concrete, technical examples of how to achieve local AI, making their content more relatable and actionable.