The First Signs Of AI Change: Insights From Thinking Machines’ Inkling
AIThis post was created with the assistance of artificial intelligence (AI).

TL;DR

Thinking Machines announced the release of Inkling, a 975-billion-parameter open-weight AI model, emphasizing transparency and openness. The model is not the strongest but demonstrates a new approach to AI deployment and licensing, raising questions about open source and usage policies.

Thinking Machines has officially released Inkling, a 975-billion-parameter, open-weight multimodal AI model, available on Hugging Face under the Apache 2.0 license. This move signals a shift towards greater transparency and openness in the AI industry, contrasting with many proprietary models.

Before you orderOffer from Amazon

Get everyday essentials delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Inkling is a Mixture-of-Experts transformer with 975 billion total parameters and 41 billion active, supporting a 1-million-token context window. It was trained on 45 trillion tokens encompassing text, images, audio, and video, with a native multimodal input design that processes text, images, and audio jointly without an external vision adapter.

Unlike many recent models, Inkling’s weights are openly available on Hugging Face under Apache 2.0, allowing anyone to download, modify, and deploy independently. The model was trained using a hybrid optimizer on NVIDIA GB300 systems, with over 30 million reinforcement learning rollouts improving its reasoning capabilities.

However, the model’s release is accompanied by a Model Acceptable Use Policy (AUP), which reportedly restricts surveillance, deception, and automated decision-making affecting individuals, raising questions about the true openness of the model’s licensing and use restrictions.

At a glance
reportWhen: announced April 2024
The developmentThinking Machines has publicly released its large multimodal AI model, Inkling, with open weights under Apache 2.0, marking a significant move towards transparency in AI development.

Implications of Open-Weight Release in AI Industry

The release of Inkling under open weights represents a notable departure from the trend of proprietary models, potentially enabling broader access and innovation. It underscores a shift towards transparency, but the accompanying use restrictions highlight ongoing tensions between openness and control, impacting how organizations may adopt and trust such models. This move could influence future open-source AI development and licensing practices, emphasizing the importance of clarity around licensing and usage policies for responsible AI deployment.

Products Worth Considering

Kindle Paperwhite Signature Edition 32GB (2024 Model) - Metallic Black

Kindle Paperwhite Signature Edition 32GB (2024 Model) – Metallic Black

As an affiliate, we earn on qualifying purchases.

Background of AI Model Releases and Industry Trends

Over recent years, many leading AI models have been released as closed-source, with proprietary weights and restricted licenses, limiting independent scrutiny and customization. The industry has seen debates over transparency, safety, and control, especially following incidents where models were shut down or restricted due to regulatory or ethical concerns.

Thinking Machines, founded by former OpenAI CTO, has taken a different approach by releasing Inkling’s weights openly, albeit with some restrictions. This aligns with a broader movement advocating for open models, but also raises questions about the balance between openness and responsible use.

“Open weights are not the same as open source. The restrictions layered on top could limit real openness.”

— Industry observer, on X

Unresolved Questions About Inkling’s Use Restrictions

While the weights are openly available, reports suggest that Thinking Machines enforces a separate Model Acceptable Use Policy (AUP) that restricts surveillance, deception, and certain decision-making applications. The exact scope, enforceability, and transparency of this policy remain unverified, raising questions about the true openness of the model.

It is not yet clear how these restrictions will impact commercial or research use, or whether they will be enforced uniformly across different jurisdictions.

Next Steps for Adoption and Policy Clarification

Expect independent researchers and organizations to scrutinize Inkling’s licensing and restrictions closely. Further testing and benchmarking will likely follow to assess its safety, robustness, and compliance with stated policies. Additionally, more details about the Model Acceptable Use Policy are anticipated to clarify the boundaries of permissible use.

Thinking Machines may release updated versions or clarify the licensing framework, influencing how open-source models evolve in the industry.

Key Questions

What makes Inkling different from other large language models?

Inkling is notable for its open weights under Apache 2.0 license, multimodal input support, and a focus on transparency, although it reportedly includes usage restrictions via a separate policy.

Is Inkling truly open source?

The weights are openly available under Apache 2.0, but reports suggest that a separate Acceptable Use Policy imposes restrictions, which complicates the notion of full openness.

Why does the licensing matter for users?

Licensing determines what users can do with the model—whether they can modify, deploy, or commercialize it freely. Restrictions could limit applications, especially in sensitive domains like surveillance or automated decision-making.

What are the potential risks of using Inkling?

Risks include uncertainties around enforcement of use restrictions, possible limitations on deployment, and ethical concerns if restrictions are not transparent or are difficult to comply with.

What impact could Inkling have on the AI industry?

Its open weights could encourage more open development and experimentation, but the layered restrictions highlight ongoing debates over balancing transparency with control and safety in AI deployment.

Source: ThorstenMeyerAI.com

You May Also Like

AI Lab Week, Summed Up: 10 Moves From Seven Labs

A November 2–8 roundup tracks 10 announcements from seven AI labs, including agent memory, private and released model weights, and new media tools.

Air Filter Replacing: 5 Easy Steps for Better Air Quality

Begin your journey towards better air quality with these 5 easy steps for replacing air filters that will transform your home environment.

Unraveling the Mystery: What Is the AI Trend?

AIThis post was created with the assistance of artificial intelligence (AI).Artificial intelligence…

What are the risks of an LNG tanker explosion?

Exploring the dangers and potential consequences of LNG tanker explosions in the Strait of Hormuz, with expert insights and current assessments.