FAQ

The modern data stack lacks unstructured data processing capabilities.

Processing unstructured data is challenging. We struggled with connecting data from different sources, developing deep learning models, deploying them, managing day-to-day operations, and continually building MLOps tools to maintain pipeline resilience and consistent AI performance. All of this was done in-house and was not scalable.

There must be a better way, and Instill Core is the solution.

To make AI accessible to everyone, the focus should not only be on algorithms (i.e., AI models) but also on the infrastructure tools that connect these algorithms with the modern data stack end-to-end.

For a more detailed narrative, read our blog articles "Why Instill AI exists" and "Missing piece in modern data stack: unstructured data ETL".

We are the Instill AI team. Our team is composed of agile professionals with years of experience in Computer Vision, Machine Learning, Deep Learning, large-scale databases, and cloud-native applications/infrastructure. We possess extensive knowledge in creating and managing complex AI systems.

Prior to the development of Instill Core, we grappled with the challenge of streaming large volumes of data (billions of images daily!) to automate Vision tasks using deep learning models, painstakingly building everything from the ground up.

We've learned that effective model serving for a seamless end-to-end data flow not only requires high throughput and low latency, but also cost-effectiveness. Achieving these criteria simultaneously is no easy feat. Eventually, we successfully constructed a robust AI system in-house that has been operational for years.

The system we built can be broken down into functional components that can be utilized across a wide range of AI Tasks and industries. We believe it's time to leverage our experience to make AI more accessible to everyone, particularly those in the data industry.

Instill Core uses multiple licenses, including Instill Community License and the most permissive MIT License. Our mission is to make AI accessible to everyone. The best way to achieve this is to make Instill Core free to use and source available to everyone, while ensuring we safely create a sustainable business. Please check the License page for details.

Yes. It is source available so you can self-host it in your basement for free.

Instill Core's backend components are Go-based and frontend console is written in Next.js, TypeScript, and TailwindCSS.

However, Instill Core is designed with an API-first and cloud-native approach. It can be interacted with using cURL or the auto-generated codes from protobuf. We also offer Python and TypeScript SDKs to help users incorporate Instill Core into their current technology stack. Plans to develop more user-friendly SDKs in multiple languages are in our future roadmap.

The Instill Core leverages the Microservice architecture, making it adaptable, versatile, and reusable, especially in situations where new components are continuously integrated. This architecture also enhances scalability, allowing each backend instance to scale based on its specific workload.

The IDEALS (Interface segregation, Deployability, Event-driven, Availability over consistency, Loose coupling, and Single responsibility) design principle provides a stringent framework for addressing design queries during the development of Instill Core.

The API-first approach is a natural outcome of adopting the microservice architecture and IDEALS. All backend components in Instill Core are designed with the API-first principle, ensuring a solid contract for future integration tasks.

The twelve-factor methodology offers practical guidelines for the development and deployment of Instill Core components.

We envision a future where AI and Data industry tooling development is fully modularized. This means that MLOps components should prioritize flexibility, extensibility, and composability in their design principles.